[jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-836) Error in load using dataframe - columns containing comma

Akash R Nilugal (Jira)
Sanoj MG created CARBONDATA-836:
-----------------------------------

             Summary: Error in load using dataframe  - columns containing comma
                 Key: CARBONDATA-836
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-836
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
    Affects Versions: 1.1.0-incubating
         Environment: HDP sandbox 2.5, Spark 1.6.2
            Reporter: Sanoj MG
            Priority: Minor
             Fix For: NONE


While trying to load data into Carabondata table using dataframe, the columns containing commas are not properly loaded.

Eg:
scala> df.show(false)
+-------+------+-----------+----------------+---------+------+
|Country|Branch|Name       |Address         |ShortName|Status|
+-------+------+-----------+----------------+---------+------+
|2      |1     |Main Branch|XXXX, Dubai, UAE|UHO      |256   |
+-------+------+-----------+----------------+---------+------+


scala>  df.write.format("carbondata").option("tableName", "Branch1").option("compress", "true").mode(SaveMode.Overwrite).save()


scala> cc.sql("select * from branch1").show(false)

+-------+------+-----------+-------+---------+------+
|country|branch|name       |address|shortname|status|
+-------+------+-----------+-------+---------+------+
|2      |1     |Main Branch|XXXX   | Dubai   |null  |
+-------+------+-----------+-------+---------+------+






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)