Jacky Li created CARBONDATA-188:
-----------------------------------
Summary: Compress CSV file while loading
Key: CARBONDATA-188
URL:
https://issues.apache.org/jira/browse/CARBONDATA-188 Project: CarbonData
Issue Type: Improvement
Components: core, spark-integration
Affects Versions: 0.1.0-incubating
Reporter: Jacky Li
Fix For: 0.2.0-incubating
Currently when loading CarbonData file using Spark Dataframe API, it will firstly save as CSV file then load to CarbonData file.
Sometimes CSV requires a lot of disk space, suggest to compress the CSV before loading, thus disk space required is less.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)