Refactored SegmentPropertiesFetcher to resolve pruning problem post the carbon schema restructure.

Posted by mohdshahidkhan on May 03, 2018; 12:24pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Refactored-SegmentPropertiesFetcher-to-resolve-pruning-problem-post-the-carbon-schema-restructure-tp48018.html

Hi Dev,

Currently DataMap while pruning is considering SegmentProperties from the
0th block of Segment DataMap.
It is not correct as post schema restructure if the table is updated
(*Update/Delete record*) then within the segment, all the block will not
have symmetric schema.

To support schema restructure, it must be ensured that the block is pruned
with its own columns schema.


Regards,
Shahid



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/