Re: Support SI at Segment level

Posted by Nihal on Apr 05, 2021; 8:45am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Support-SI-at-Segment-level-tp106256p107370.html

Hi All,
    Thanks for your input and suggestion.

    For now, we will support leveraging SI to segment level only with SQL
plan rewrite(already mentioned in this thread and design document).

   As a parallel work is going on to support SI as datamap(without plan
rewrite), which will be at table level.
This work is independent of the existing property "isSITableEnabled"
as mentioned in the design doc or  PR 4110
<https://github.com/apache/carbondata/pull/4110>  .
Also, there is no other major conflict or dependency between both designs.
So we can safely handle both the work parallelly.

    We are planning to leverage the datamap SI to the segment level
later(once the PR merged). I will create a separate JIRA ticket to track
this work.


Regards
Nihal kumar ojha



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/