[jira] [Created] (CARBONDATA-780) Alter table support for compaction through sort step

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-780) Alter table support for compaction through sort step

Akash R Nilugal (Jira)
Manish Gupta created CARBONDATA-780:
---------------------------------------

             Summary: Alter table support for compaction through sort step
                 Key: CARBONDATA-780
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-780
             Project: CarbonData
          Issue Type: Sub-task
            Reporter: Manish Gupta
            Assignee: Manish Gupta


Alter table need to support compaction process where complete data need to be sorted again and then written to file.

Currently in compaction process data is directly given to writer step where it is splitted into columns and written. But as columns are sorted from left to right, on dropping a column data will again become unorganized as dropped column data will not be considered during compaction. In these scenarios complete data need to be sorted again and then submitted to writer step.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)