RE: Re:[DISCUSSION] Support Incremental load in datamap and other MV datamap enhancement
Posted by
xuchuanyin on
Feb 19, 2019; 6:50am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-Incremental-load-in-datamap-and-other-MV-datamap-enhancement-tp75160p75229.html
I think there is still misunderstanding between us.
Here I only concern about the lazy build for index datamap.
I think each segment should has its own datamap status and based on this we
can support pruning by index datamap for each segment. After this, even the
datamap is lazy, during query we can still make use of the index data of the
historical segments (which already have index data generated).
--
Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/