Posted by
haomarch on
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Improving-show-segment-info-tp91874p92072.html
The problem users concerned is more likely: What partitions do not have
completely loaded?
If wer just add partition-segment list in "show partitions", or
"min/max(timecolumn)" in "show segemnts", the above question can't be
answered clearly.
The recommendation is, add a new cammand "show partitions with stage
details", to show whether each partition is loaded completely, for example
| dtm-20200219/hh=13 | incompletely load
| dtm-20200219/hh=14 | completely load
| dtm-20200219/hh=15 | completely load
| dtm-20200219/hh=16 | completely load
| dtm?20200219/hh=17 | incompletely load
From above, hh=13 is not loaded completely for some reason, It is clear that
The delay is start from hh=13.
===============================
Sum up, shall we add a new cammand "show partitions with stage details", to
show below infos:
1. whether loaded completely?
2. how many stages files have not been loaded
3. the start load time and end load time
4. the data volume of the partitions
5. so on....
--
Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/