Re: Improve carbondata CDC performance

Posted by VenuReddy on Feb 24, 2021; 6:38am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Improve-carbondata-CDC-performance-tp106093p106439.html


Hi Akash,

+1

Just ad few queries regd. query to filter only necessary target
files/blocks. -

SELECT target.filepath
                FROM targetTable,srcTable
WHERE srcTable.value BETWEEN targetTable.min AND targetTable.max;

1. This range will be one per the extended blocklet. right ? I mean, number
of ranges in the condition is equal to number extended blockets returned. Do
we merge these ranges(in case of overlaps ) to reduce the number of
conditions??

2. Doing aggregate/group by target.filepath helps?

Regards,
Venu



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/