GitHub user manishgupta88 opened a pull request:
https://github.com/apache/carbondata/pull/2510 [WIP] [CARBONDATA-2649] Fixed arrayIndexOutOfBoundException while loading Blocklet DataMap after alter add column operation
Things done as part of this PR
1. Fixed arrayIndexOutOfBoundException while loading Blocklet DataMap after alter add column operation
**Problem:**
Array Index out of bound exception was thrown after alter add column operation.
**Analysis:**
After alter add column operation if COLUMN_META_CACHE is set on the newly added columns, then on executing select query on the data loaded before alter operation threw exception. This was because minMaxCache caching columns were fetched irrespective of the segmentProperties. Data loaded before alter add column operation will not have the newly added columns in its columnSchemaList and hence can throw exception if non existent column are not removed from min/max column cache.
**Solution:**
Fetch the min/max cache columns based on segmentProperties
- [ ] Any interfaces changed?
No
- [ ] Any backward compatibility impacted?
No
- [ ] Document update required?
No
- [ ] Testing done
Added test case
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
NA
You can merge this pull request into a Git repository by running:
$ git pull
https://github.com/manishgupta88/carbondata index_load_failure_after_alter_add_column
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2510.patchTo close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2510
----
commit 061782978192f32d131c7b629bbc5111382e5273
Author: m00258959 <manish.gupta@...>
Date: 2018-07-16T06:56:41Z
Fixed arrayIndexOutOfBoundException while loading Blocklet DataMap after alter add column operation
----
---
Locked
