[jira] [Created] (CARBONDATA-188) Compress CSV file while loading

Posted by Akash R Nilugal (Jira) on Aug 29, 2016; 9:10am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-188-Compress-CSV-file-while-loading-tp539.html

Jacky Li created CARBONDATA-188:
-----------------------------------

             Summary: Compress CSV file while loading
                 Key: CARBONDATA-188
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-188
             Project: CarbonData
          Issue Type: Improvement
          Components: core, spark-integration
    Affects Versions: 0.1.0-incubating
            Reporter: Jacky Li
             Fix For: 0.2.0-incubating


Currently when loading CarbonData file using Spark Dataframe API, it will firstly save as CSV file then load to CarbonData file.

Sometimes CSV requires a lot of disk space,  suggest to compress the CSV before loading, thus disk space required is less.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)