Re: Improve carbondata CDC performance

Posted by David CaiQiang on Feb 18, 2021; 1:06am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Improve-carbondata-CDC-performance-tp106093p106302.html

Hi Akash,
    You can enhance the runtime filter to improve the join performance.

    It has the rule to dynamically check whether the join can add the
runtime filter or not.

    Better to push down the runtime filter into CarbonDataSourceScan, and
better to avoid adding a UDF function to rewrite the plan.

   



-----
Best Regards
David Cai
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/