Re: [Feature ]Design Document for Update/Delete support in CarbonData

Posted by Jacky Li on Nov 27, 2016; 1:35am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Feature-Design-Document-for-Update-Delete-support-in-CarbonData-tp3043p3237.html

Hi Aniket,

Yes, background monitor process is preferred in the future. And there are other places need this process already, like refreshing the caches in driver and executors. Currently, dictionary caches and index caches are refreshed by checking timestamp in every query, which introduces unnecessary overhead in query flow and impact NameNode in concurrent query scenario.

Regards,
Jacky