[jira] [Resolved] (CARBONDATA-3885) In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-3885) In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Akash R Nilugal resolved CARBONDATA-3885.
-----------------------------------------
    Fix Version/s:     (was: 2.0.0)
                   2.1.0
       Resolution: Fixed

> In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.
> --------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3885
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3885
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>    Affects Versions: 2.0.0
>            Reporter: Vikram Ahuja
>            Priority: Minor
>             Fix For: 2.1.0
>
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.
> The steps to create this issue:
> 1. Create table a
> 2. Create SI on table a. Let’s call it a_index
> 3. Insert/Load 3-4 times in main table(a)
> 4. Check the segments in both the table(should be same)
> 5. Now delete segments from hdfs from path SI_table/Fact/Part0/Segment_number
> 6. Also delete the segments entry from table status file (Metadata/tablestatus file)
> 7. Now check the segments on both the table(SI segments will be less)
> 8. Do another load/insert. Segment will be inserted in both tha tables, but the delete segment will not be loaded in SI
> 9. Now run command "alter table DBName.SIName set SERDEPROPERTIES('isSITableEnabled'='false');"
> 10. check show index on maintable; It will be disabled mode
> 11. Do another load/insert. Segment will be inserted in both the tables. The previous deleted segments should be added in SI table(but it fails at this step)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)