Sanoj MG created CARBONDATA-836:
-----------------------------------
Summary: Error in load using dataframe - columns containing comma
Key: CARBONDATA-836
URL:
https://issues.apache.org/jira/browse/CARBONDATA-836 Project: CarbonData
Issue Type: Bug
Components: spark-integration
Affects Versions: 1.1.0-incubating
Environment: HDP sandbox 2.5, Spark 1.6.2
Reporter: Sanoj MG
Priority: Minor
Fix For: NONE
While trying to load data into Carabondata table using dataframe, the columns containing commas are not properly loaded.
Eg:
scala> df.show(false)
+-------+------+-----------+----------------+---------+------+
|Country|Branch|Name |Address |ShortName|Status|
+-------+------+-----------+----------------+---------+------+
|2 |1 |Main Branch|XXXX, Dubai, UAE|UHO |256 |
+-------+------+-----------+----------------+---------+------+
scala> df.write.format("carbondata").option("tableName", "Branch1").option("compress", "true").mode(SaveMode.Overwrite).save()
scala> cc.sql("select * from branch1").show(false)
+-------+------+-----------+-------+---------+------+
|country|branch|name |address|shortname|status|
+-------+------+-----------+-------+---------+------+
|2 |1 |Main Branch|XXXX | Dubai |null |
+-------+------+-----------+-------+---------+------+
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)