[jira] [Created] (CARBONDATA-3986) multiple issues during compaction and concurrent scenarios

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3986) multiple issues during compaction and concurrent scenarios

Akash R Nilugal (Jira)
Ajantha Bhat created CARBONDATA-3986:
----------------------------------------

             Summary: multiple issues during compaction and concurrent scenarios
                 Key: CARBONDATA-3986
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3986
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


multiple issues during compaction and concurrent scenarios
a) Auto compaction/multiple times minor compaction is called, it was considering compacted segments and coming compaction again ad overwriting the files and segments
b) Minor/ auto compaction should skip >=2 level segments, now only skipping =2 level segments
c) when compaction failed, no need to call merge index
d) At executor, When segment file or table status file failed to write during merge index event, need to remove the stale files.
e) during partial load cleanup segment folders are removed but segment metadata files were not removed
f) Some table status retry issues



--
This message was sent by Atlassian Jira
(v8.3.4#803005)