Re: The size of the tablestatus file is getting larger, does it impact the performance of reading this file?
Posted by
Jacky Li on
Mar 14, 2018; 6:47am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/The-size-of-the-tablestatus-file-is-getting-larger-does-it-impact-the-performance-of-reading-this-fi-tp41941p41982.html
Hi,
Yes, I think you are right. Currently CLEAN FILES command only delete the segment data folder, but not deleting metadata entries in table_status file, I think this is the problem.
Please feel free to open a JIRA ticket and improve it. Thanks.
Regards,
Jacky
> 在 2018年3月14日,上午10:28,xm_zzc <
[hidden email]> 写道:
>
> Hi dev:
> The size of the tablestatus file is getting larger, does it impact the
> performance of reading this file, for example 1 million segment info in this
> file? There are many places will scan this file.
> Why not delete the invisible segment info to reduce the size of
> tablestatus file? will they be used later?
>
>
> --
> Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/