[jira] [Updated] (CARBONDATA-2289) If carbon merge index is enabled then after IUD operation if some blocks of a segment is deleted, then during query and IUD operation the driver is throwing FileNotFoundException while preparing BlockMetaInfo.

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mohammad Shahid Khan updated CARBONDATA-2289:
---------------------------------------------
    Description:
Root cause:

The carbonindexmerge file is containing deleted blocks (.*carbondata*) meta i.e. driver tries to load BlockletDataMap for deleted blocks and fails while populating BlockMetaInfo.

 Steps to reproduce:

sql("drop table if exists mitable")
sql("create table mitable(id int, issue date) stored by 'carbondata'")
sql("insert into table mitable select '1','2000-02-01'")
val table = CarbonMetadata.getInstance().getCarbonTable("default", "mitable")
new CarbonIndexFileMergeWriter()
 .mergeCarbonIndexFilesOfSegment("0", table.getTablePath, false)
sql("update mitable set(id)=(2) where issue = '2000-02-01'").show()
sql("clean files for table mitable")
sql("select * from mitable").show()

  was:
Root cause:

The carbonindexmerge file is containing deleted blocks (.*carbondata*) meta i.e. driver tries to load BlockletDataMap for deleted blocks and fails while populating BlockMetaInfo.

 

> If carbon merge index is enabled then after IUD operation if some blocks of a segment is deleted, then during query and IUD operation the driver is throwing FileNotFoundException while preparing BlockMetaInfo.
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-2289
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2289
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Mohammad Shahid Khan
>            Priority: Minor
>
> Root cause:
> The carbonindexmerge file is containing deleted blocks (.*carbondata*) meta i.e. driver tries to load BlockletDataMap for deleted blocks and fails while populating BlockMetaInfo.
>  Steps to reproduce:
> sql("drop table if exists mitable")
> sql("create table mitable(id int, issue date) stored by 'carbondata'")
> sql("insert into table mitable select '1','2000-02-01'")
> val table = CarbonMetadata.getInstance().getCarbonTable("default", "mitable")
> new CarbonIndexFileMergeWriter()
>  .mergeCarbonIndexFilesOfSegment("0", table.getTablePath, false)
> sql("update mitable set(id)=(2) where issue = '2000-02-01'").show()
> sql("clean files for table mitable")
> sql("select * from mitable").show()

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)