> data mismatch observed with SI and without SI when SI global sort and SI segment merge is true
> ----------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-4066
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-4066> Project: CarbonData
> Issue Type: Bug
> Reporter: Mahesh Raju Somalaraju
> Priority: Major
> Fix For: 2.2.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> data mismatch observed with SI and without SI when SI global sort and SI segment merge is true
>
> test case for reproduce the issue:
> CarbonProperties.getInstance()
> .addProperty(CarbonCommonConstants.CARBON_SI_SEGMENT_MERGE, "true")
> sql("create table complextable2 (id int, name string, country array<string>) stored as " +
> "carbondata tblproperties('sort_scope'='global_sort','sort_columns'='name')")
> sql(
> s"load data inpath '$resourcesPath/secindex/array.csv' into table complextable2 options('delimiter'=','," +
> "'quotechar'='\"','fileheader'='id,name,country','complex_delimiter_level_1'='$'," +
> "'global_sort_partitions'='10')")
> val result = sql(" select * from complextable2 where array_contains(country,'china')")
> sql("create index index_2 on table complextable2(country) as 'carbondata' properties" +
> "('sort_scope'='global_sort')")
> checkAnswer(sql("select count(*) from complextable2 where array_contains(country,'china')"),
> sql("select count(*) from complextable2 where ni(array_contains(country,'china'))"))
Locked
