Why is slower that build ChunkRowIterator object in presto plugin of carbondata?
Posted by rui qin on Jul 05, 2017; 10:04am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Why-is-slower-that-build-ChunkRowIterator-object-in-presto-plugin-of-carbondata-tp17356.html
Hi,all
Based on tpc-h,I have tested some sql in presto plugin of carbondata,but not very well.I found some reasons and that each split in building ChunkRowIterator object is time consuming(More than 2 seconds).
Is there any suggestions for optimization?
issue code:
org.apache.carbondata.presto.CarbondataRecordSet
public RecordCursor cursor() {
...
CarbonIterator<Object[]> carbonIterator =
new ChunkRowIterator((CarbonIterator<BatchResult>) queryExecutor.execute(queryModel));
...
}