[GitHub] [carbondata] ajantha-bhat commented on issue #3444: [CARBONDATA-3581] Support page level bloom filter

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] ajantha-bhat commented on issue #3444: [CARBONDATA-3581] Support page level bloom filter

GitBox
ajantha-bhat commented on issue #3444: [CARBONDATA-3581] Support page level bloom filter
URL: https://github.com/apache/carbondata/pull/3444#issuecomment-557768125
 
 
   > @ajantha-bhat sorry, I'm not quite get the algorithm you mean.
   currently we use Murmur Hash with multiple hash values for items added into bloom, position of the hash values is set to true. Query value will be considered inside the page only when all position of its hash vallue is true in the bitmap.
   
   @kevinjmh : currently we use only one hash function (murmur hash) , result of it also may be false positive in case of hash collision. To improve this scenario. People use more than one hash function for same value (example fnv hash). Then if both the algorithm says true, then only it is considered to be exists.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services