[jira] [Commented] (CARBONDATA-188) Compress CSV file while loading
Posted by Akash R Nilugal (Jira) on Sep 06, 2016; 2:43pm URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Commented-CARBONDATA-188-Compress-CSV-file-while-loading-tp802.html
> Compress CSV file while loading
> -------------------------------
>
> Key: CARBONDATA-188
> URL: https://issues.apache.org/jira/browse/CARBONDATA-188 > Project: CarbonData
> Issue Type: Improvement
> Components: core, spark-integration
> Affects Versions: 0.1.0-incubating
> Reporter: Jacky Li
> Fix For: 0.2.0-incubating
>
>
> Currently when loading CarbonData file using Spark Dataframe API, it will firstly save as CSV file then load to CarbonData file.
> Sometimes CSV requires a lot of disk space, suggest to compress the CSV before loading, thus disk space required is less.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)