[jira] [Updated] (CARBONDATA-836) Error in load using dataframe - columns containing comma

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-836) Error in load using dataframe - columns containing comma

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala updated CARBONDATA-836:
---------------------------------------
    Fix Version/s:     (was: NONE)
                   1.1.1

> Error in load using dataframe  - columns containing comma
> ---------------------------------------------------------
>
>                 Key: CARBONDATA-836
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-836
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 1.1.0
>         Environment: HDP sandbox 2.5, Spark 1.6.2
>            Reporter: Sanoj MG
>            Assignee: Sanoj MG
>            Priority: Minor
>             Fix For: 1.1.1
>
>
> While trying to load data into Carabondata table using dataframe, the columns containing commas are not properly loaded.
> Eg:
> scala> df.show(false)
> +-------+------+-----------+----------------+---------+------+
> |Country|Branch|Name       |Address         |ShortName|Status|
> +-------+------+-----------+----------------+---------+------+
> |2      |1     |Main Branch|XXXX, Dubai, UAE|UHO      |256   |
> +-------+------+-----------+----------------+---------+------+
> scala>  df.write.format("carbondata").option("tableName", "Branch1").option("compress", "true").mode(SaveMode.Overwrite).save()
> scala> cc.sql("select * from branch1").show(false)
> +-------+------+-----------+-------+---------+------+
> |country|branch|name       |address|shortname|status|
> +-------+------+-----------+-------+---------+------+
> |2      |1     |Main Branch|XXXX   | Dubai   |null  |
> +-------+------+-----------+-------+---------+------+



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)