[jira] [Created] (CARBONDATA-863) Support creation and deletion of dictionary files through RDD during alter add and drop

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-863) Support creation and deletion of dictionary files through RDD during alter add and drop

Akash R Nilugal (Jira)
Manish Gupta created CARBONDATA-863:
---------------------------------------

             Summary: Support creation and deletion of dictionary files through RDD during alter add and drop
                 Key: CARBONDATA-863
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-863
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Manish Gupta
            Assignee: Manish Gupta
            Priority: Minor
             Fix For: 1.1.0-incubating


Currently during alter add and drop columns operation, dictionary files for columns are being added and dropped in a single thread due to which the operation becomes very slow as the number of columns increases.

Instead this operation should be done through RDD which will make optimal use of executor cores configured and performance will increase by number of cores configured.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)