[jira] [Resolved] (CARBONDATA-3881) concurrent main table compaction and SI load issue

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ajantha Bhat resolved CARBONDATA-3881.
--------------------------------------
    Fix Version/s: 2.1.0
       Resolution: Fixed

[https://github.com/apache/carbondata/pull/3810]

> concurrent main table compaction and SI load issue
> --------------------------------------------------
>
>                 Key: CARBONDATA-3881
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3881
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Ajantha Bhat
>            Assignee: Ajantha Bhat
>            Priority: Major
>             Fix For: 2.1.0
>
>          Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> problem: consider a scenario, where segmentX has loaded to main table but failed to load to SI table. So, while loading another segmentY, we reload failed SI segmentX. this time if the segmentX is compacted in main table and clean files executed on it. SI load will fail and segmented will not be found in segmentMap of SI and it throws exception.
>  
> solution: just before reloading the failed SI segment. check if it is valid segment in main table.
>  
>  

--
This message was sent by Atlassian Jira
(v8.3.4#803005)