Re:[DISCUSSION] Support Incremental load in datamap and other MV datamap enhancement

Posted by xuchuanyin on Feb 15, 2019; 3:34pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-Incremental-load-in-datamap-and-other-MV-datamap-enhancement-tp75160p75167.html

Hi Akash, please note that if the index datamap supports lazy build, then there could be a chance that only some segments that have corresponding index data while some do not, which means that carbondata should handle this situation during query.

We cannot just discard the existing index otherwise the query performance will be affected.

Hope your design has handle this properly.

Thanks.

Sent from my Huawei phone