Posted by
xuchuanyin-2 on
Sep 21, 2017; 6:25am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Update-the-function-of-show-segments-tp22479p22936.html
If adding a new statement, I suggest to learn from hive:
desc formatted table_name;
VS
desc table_name;
Show segment...
VS
Show formatted segment...
On 09/21/2017 14:02, Ravindra Pesala wrote:
Hi,
I agree with Jacky and David.
But it is suggested to keep current 'show segments' command without any
change and provide only brief information about segments.
Add new extended command like `extended show segments` to provide more
information which is required for power user.
Regards, only
Ravindra.
On 21 September 2017 at 09:03, David CaiQiang <
[hidden email]> wrote:
> I agree with Jacky.
>
> I think enhanced segment metadata will help us to understand the table.
>
> I suggest the following properties for segment metadata:
> 1. total data file size
> 2. total index file size
> 3. data file count
> 4. index file count
> 5. last modified time (last update time)
>
> Through these information, we can answer the following questions.
> 1. Is there small file issue? Whether table require compaction or not,
> which
> type should be used?
> 2. Whether index files is too many or not? we will can estimate the total
> size of index in memory whether it is big or small for driver memory
> configuration.
> 3. Whether some segment has too many files? Maybe it is useful to locate
> some performance issue.
>
>
>
> -----
> Best Regards
> David Cai
> --
> Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.
> n5.nabble.com/
>
--
Thanks & Regards,
Ravi