Sanoj MG created CARBONDATA-909:
-----------------------------------
Summary: Single pass option in dataframe writer
Key: CARBONDATA-909
URL:
https://issues.apache.org/jira/browse/CARBONDATA-909 Project: CarbonData
Issue Type: Bug
Components: spark-integration
Affects Versions: 1.2.0-incubating, 1.1.1-incubating
Environment: HDP 2.5 / Spark 1.6
Reporter: Sanoj MG
Assignee: Sanoj MG
Priority: Minor
Fix For: 1.2.0-incubating, 1.1.1-incubating
While creating a Carbondata table from dataframe, currently it is not possible to specify single pass load in Spark 1.6. An option is required to specify it as below :
df.write.format("carbondata")
.option("tableName", "test")
.option("compress","true")
.option("single_pass","true")
.mode(SaveMode.Overwrite)
.save()
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)