[jira] [Created] (CARBONDATA-3885) In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.

[Akash R Nilugal (Jira)]

Vikram Ahuja created CARBONDATA-3885:
----------------------------------------

             Summary: In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.
                 Key: CARBONDATA-3885
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3885
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
    Affects Versions: 2.0.0
            Reporter: Vikram Ahuja
             Fix For: 2.0.0


In the case when in the SI table a segment is deleted and it's entry is deleted from the tablestatus file, during next load command, load into SI fails.

The steps to create this issue:

1. Create table a
2. Create SI on table a. Let’s call it a_index
3. Insert/Load 3-4 times in main table(a)
4. Check the segments in both the table(should be same)
5. Now delete segments from hdfs from path SI_table/Fact/Part0/Segment_number
6. Also delete the segments entry from table status file (Metadata/tablestatus file)
7. Now check the segments on both the table(SI segments will be less)
8. Do another load/insert. Segment will be inserted in both tha tables, but the delete segment will not be loaded in SI
9. Now run command "alter table DBName.SIName set SERDEPROPERTIES('isSITableEnabled'='false');"
10. check show index on maintable; It will be disabled mode
11. Do another load/insert. Segment will be inserted in both the tables. The previous deleted segments should be added in SI table(but it fails at this step)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)