[jira] [Created] (CARBONDATA-4123) Bloom index query with Index server giving incorrect results

[Akash R Nilugal (Jira)]

SHREELEKHYA GAMPA created CARBONDATA-4123:
---------------------------------------------

             Summary: Bloom index query with Index server giving incorrect results
                 Key: CARBONDATA-4123
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4123
             Project: CarbonData
          Issue Type: Bug
            Reporter: SHREELEKHYA GAMPA


Queries: create table and load data so that it can create >1 blocklet.

 

spark-sql> select count(*) from test_rcd where city = 'city40';
2021-02-04 22:13:29,759 | WARN | pool-24-thread-1 | It is not recommended to set off-heap working memory size less than 512MB, so setting default value to 512 | org.apache.carbondata.core.memory.UnsafeMemoryManager.<clinit>(UnsafeMemoryManager.java:83)
10
Time taken: 2.417 seconds, Fetched 1 row(s)
spark-sql> CREATE INDEX dm_rcd ON TABLE test_rcd (city) AS 'bloomfilter' properties ('BLOOM_SIZE'='640000', 'BLOOM_FPP'='0.00001');
2021-02-04 22:13:58,683 | AUDIT | main | \{"time":"February 4, 2021 10:13:58 PM CST","username":"carbon","opName":"CREATE INDEX","opId":"15148202700230273","opStatus":"START"} | carbon.audit.logOperationStart(Auditor.java:74)
2021-02-04 22:13:58,759 | WARN | main | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
2021-02-04 22:13:59,292 | WARN | Executor task launch worker for task 2 | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
2021-02-04 22:13:59,629 | WARN | main | Bloom compress is not configured for index dm_rcd, use default value true | org.apache.carbondata.index.bloom.BloomCoarseGrainIndexFactory.validateAndGetBloomCompress(BloomCoarseGrainIndexFactory.java:202)
2021-02-04 22:14:00,331 | AUDIT | main | \{"time":"February 4, 2021 10:14:00 PM CST","username":"carbon","opName":"CREATE INDEX","opId":"15148202700230273","opStatus":"SUCCESS","opTime":"1648 ms","table":"default.test_rcd","extraInfo":{"provider":"bloomfilter","indexName":"dm_rcd","bloom_size":"640000","bloom_fpp":"0.00001"}} | carbon.audit.logOperationEnd(Auditor.java:97)
Time taken: 1.818 seconds
spark-sql> select count(*) from test_rcd where city = 'city40';
30
Time taken: 0.556 seconds, Fetched 1 row(s)
spark-sql>



--
This message was sent by Atlassian Jira
(v8.3.4#803005)