[jira] [Assigned] (CARBONDATA-3579) Support merge index files when adding partition

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li reassigned CARBONDATA-3579:
------------------------------------

    Assignee: Jacky Li

> Support merge index files when adding partition
> -----------------------------------------------
>
>                 Key: CARBONDATA-3579
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3579
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Jacky Li
>            Assignee: Jacky Li
>            Priority: Major
>             Fix For: 2.0.0
>
>
> Normally, application will use Carbon SDK to write files into a partition folder, then add the folder to partitioned carbon table.
> If there are many threads writes to the same partition folder, there will be many carbon index files, and it is not good for query performance since all index files need to be read to spark driver.
> So, a better way is to merge the index files when adding new partition to carbon table.

--
This message was sent by Atlassian Jira
(v8.3.4#803005)