GitHub user manishgupta88 opened a pull request:
https://github.com/apache/carbondata/pull/2515 [CARBONDATA-2714][Merge Index] Fixed block dataMap cache refresh issue after creation of merge index file
Things handled as part of this PR
1. Fixed block dataMap cache refresh issue after creation of merge index file
**Problem:**
Block DataMap cache not getting refreshed after creation of merge index file due to which queries still look for index file and fail.
**Analysis:**
Merge index file creation involves modification of segment file. If a query is executed without merge Index file creation then cache will be loaded. Once merge Index file is created the index file entries will be removed from segment file and merge index file entry will be added. In this process the cache is not getting refreshed and the tableIdentifiers created still have the mergeIndexFIleName as null.
**Fix:**
After updating table status file clear the dataMap cache for all segmentId's on which dataMap is being created
- [ ] Any interfaces changed?
No
- [ ] Any backward compatibility impacted?
No
- [ ] Document update required?
No
- [ ] Testing done
Added test case
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
NA
You can merge this pull request into a Git repository by running:
$ git pull
https://github.com/manishgupta88/carbondata merge_index_clear_cache
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2515.patchTo close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2515
----
commit d4d04ee4b6627384a02c922cbe2ead6a8b4f3ee6
Author: manishgupta88 <tomanishgupta18@...>
Date: 2018-07-17T08:54:54Z
Fixed block dataMap cache refresh issue after creation of merge index file
----
---
Locked
