Carbondata is not showing stats
Posted by
Rana Faisal Munir on
May 22, 2017; 5:39pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Carbondata-is-not-showing-stats-tp13092.html
Hi,
I am running some experiments with Parquet and Carbondata. I observe
that Carbondata is not recording statistics for Spark to display in
Spark UI (history server). I run a projection queries both on
Parquet (sqlContext.sql()) and Carbondata (carbonContext.sql()).
Parquet is showing the complete details (total tasks and # of disk
read in bytes) whereas Carbondata is not showing anything. I would
like to have these statistics for carbondata. It helps to see how
much Carbondata is reading from the disk which is very useful while
comparing it with other formats.
I have also attached screenshot to make it easy to understand. I am
using latest Carbondata version
apache-carbondata-1.1.0.
Regards
Faisal