[GitHub] [carbondata] kevinjmh commented on issue #3444: [CARBONDATA-3581] Support page level bloom filter

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] kevinjmh commented on issue #3444: [CARBONDATA-3581] Support page level bloom filter

GitBox
kevinjmh commented on issue #3444: [CARBONDATA-3581] Support page level bloom filter
URL: https://github.com/apache/carbondata/pull/3444#issuecomment-557416617
 
 
   > @kevinjmh : Instead of one has algorithm, if we support multiple algorithm at once ? (need to store bitmap for each algorithm) , we can reduce the chances of false positive to much smaller. Any thoughts on this and tried benchmarking for this ?
   
   sorry, I'm not quite get the `algorithm` you mean.
   currently we use Murmur Hash with multiple hash values for items added into bloom, position of the hash values is set to true. Query value will be considered inside the page only when all position of its hash vallue is true in the bitmap.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services