How to collect carbondata profile info?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

How to collect carbondata profile info?

carbondata-newuser
I have noticed that carbondata already provide profiler in version 1.4.
It can collect lots of information like
partitions.length,startTime,endTime,getSplitsStartTime,getSplitsEndTime,numSegments,numStreamSegments,numBlocks,distributeStartTime,distributeEndTime.
How can I get this information?



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: How to collect carbondata profile info?

Jacky Li
Carbon will print the profiling log if you enable the log by "CarbonProperties.getInstance().addProperty(CarbonCommonConstants.ENABLE_QUERY_STATISTICS, "true")


You can check all the profiler output that you mentioned in executor log.

Regards,
Jacky


> 在 2018年7月19日,下午2:46,carbondata-newuser <[hidden email]> 写道:
>
> I have noticed that carbondata already provide profiler in version 1.4.
> It can collect lots of information like
> partitions.length,startTime,endTime,getSplitsStartTime,getSplitsEndTime,numSegments,numStreamSegments,numBlocks,distributeStartTime,distributeEndTime.
> How can I get this information?
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>