GitHub user manishgupta88 opened a pull request:
https://github.com/apache/carbondata/pull/1818 [CARBONDATA-2020][Old Store Support] Add filter support for old store reading to improve query performance
**Problem**
For old stores blocklet level min/max comparison was not happening in the executor side due to which all the blocklets were getting scanned. This increased the IO and scanning time in the executor.
**Solution**
Modified code to retrieve the min/max value from blocklet node and use it for comparsion while scanning for valid blocklets.
**Note:** This PR need to be merged after #1796
- [ ] Any interfaces changed?
No
- [ ] Any backward compatibility impacted?
No
- [ ] Document update required?
No
- [ ] Testing done
Yes. Manually verified
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
NA
You can merge this pull request into a Git repository by running:
$ git pull
https://github.com/manishgupta88/carbondata filter_support_for_old_store
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/1818.patchTo close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1818
----
commit b0c7f1211c74f478fe5f561872b655a1869d6756
Author: manishgupta88 <tomanishgupta18@...>
Date: 2018-01-17T05:57:09Z
Add filter support for old store reading
----
---
Locked
Jan 17, 2018; 6:00am
