Login  Register

Re: The size of the tablestatus file is getting larger, does it impact the performance of reading this file?

Posted by Jacky Li on Mar 14, 2018; 6:47am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/The-size-of-the-tablestatus-file-is-getting-larger-does-it-impact-the-performance-of-reading-this-fi-tp41941p41982.html

Hi,

Yes, I think you are right. Currently CLEAN FILES command only delete the segment data folder, but not deleting metadata entries in table_status file, I think this is the problem.
Please feel free to open a JIRA ticket and improve it. Thanks.

Regards,
Jacky

> 在 2018年3月14日,上午10:28,xm_zzc <[hidden email]> 写道:
>
> Hi dev:
>  The size of the tablestatus file is getting larger, does it impact the
> performance of reading this file, for example 1 million segment info in this
> file? There are many places will scan this file.
>  Why not delete the invisible segment info to reduce the size of
> tablestatus file? will they be used later?
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/