[jira] [Created] (CARBONDATA-3579) Support merge index files when adding partition

[Akash R Nilugal (Jira)]

Jacky Li created CARBONDATA-3579:
------------------------------------

             Summary: Support merge index files when adding partition
                 Key: CARBONDATA-3579
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3579
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Jacky Li
             Fix For: 2.0.0


Normally, application will use Carbon SDK to write files into a partition folder, then add the folder to partitioned carbon table.
If there are many threads writes to the same partition folder, there will be many carbon index files, and it is not good for query performance since all index files need to be read to spark driver.

So, a better way is to merge the index files when adding new partition to carbon table.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)