[jira] [Created] (CARBONDATA-2032) Skip writing final data files to local disk to save disk IO in data loading

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2032) Skip writing final data files to local disk to save disk IO in data loading

Akash R Nilugal (Jira)
xuchuanyin created CARBONDATA-2032:
--------------------------------------

             Summary: Skip writing final data files to local disk to save disk IO in data loading
                 Key: CARBONDATA-2032
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2032
             Project: CarbonData
          Issue Type: Improvement
          Components: data-load
    Affects Versions: 1.3.0
            Reporter: xuchuanyin
            Assignee: xuchuanyin


Currently in data loading, carbondata write the final data files to local disk and then copy it to HDFS.

For saving disk IO, carbondata can skip this procedure and directly write these files to HDFS.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)