[jira] [Created] (CARBONDATA-188) Compress CSV file while loading

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-188) Compress CSV file while loading

Akash R Nilugal (Jira)
Jacky Li created CARBONDATA-188:
-----------------------------------

             Summary: Compress CSV file while loading
                 Key: CARBONDATA-188
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-188
             Project: CarbonData
          Issue Type: Improvement
          Components: core, spark-integration
    Affects Versions: 0.1.0-incubating
            Reporter: Jacky Li
             Fix For: 0.2.0-incubating


Currently when loading CarbonData file using Spark Dataframe API, it will firstly save as CSV file then load to CarbonData file.

Sometimes CSV requires a lot of disk space,  suggest to compress the CSV before loading, thus disk space required is less.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)