[jira] [Resolved] (CARBONDATA-738) Able to load dataframe with boolean type in a carbon table but with null values

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-738) Able to load dataframe with boolean type in a carbon table but with null values

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala resolved CARBONDATA-738.
----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.0.1-incubating

> Able to load dataframe with boolean type in a carbon table but with null values
> -------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-738
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-738
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 1.0.0-incubating
>         Environment: spark 1.6,spark 2.1
>            Reporter: anubhav tarar
>            Assignee: anubhav tarar
>            Priority: Trivial
>             Fix For: 1.0.1-incubating
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> i created a dataframe with boolean type as follows
> case class People(name: String, occupation: String, consultant: Boolean)
> val people = List(People("sangeeta", "engineer", true), People("pallavi", "consultant", true))
>     val peopleRDD: RDD[People] = cc.sc.parallelize(people)
>     val peopleDF: DataFrame = peopleRDD.toDF("name", "occupation", "id")
>      peopleDF.write
>       .format("carbondata")
>       .option("tableName", "carbon2")
>       .option("compress", "true")
>       .mode(SaveMode.Overwrite)
>       .save()
>     cc.sql("SELECT * FROM carbon2").show()
> currently boolean type is not supported in carbon data but table gets created
> but it shows me null values
> +--------+----------+----+
> |    name|occupation|  id|
> +--------+----------+----+
> | pallavi|consultant|null|
> |sangeeta|  engineer|null|
> +--------+----------+----+
> for boolean type it should throw unsupported type exception
> there is problem with carbondataframe writer



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)