[jira] [Created] (CARBONDATA-3881) concurrent main table compaction and SI load issue

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3881:
----------------------------------------

             Summary: concurrent main table compaction and SI load issue
                 Key: CARBONDATA-3881
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3881
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


problem: consider a scenario, where segmentX has loaded to main table but failed to load to SI table. So, while loading another segmentY, we reload failed SI segmentX. this time if the segmentX is compacted in main table and clean files executed on it. SI load will fail and segmented will not be found in segmentMap of SI and it throws exception.

 

solution: just before reloading the failed SI segment. check if it is valid segment in main table.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)