Login  Register

Why is slower that build ChunkRowIterator object in presto plugin of carbondata?

Posted by rui qin on Jul 05, 2017; 10:04am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Why-is-slower-that-build-ChunkRowIterator-object-in-presto-plugin-of-carbondata-tp17356.html

Hi,all
    Based on tpc-h,I have tested some sql in presto plugin of carbondata,but not very well.I found some reasons and that each split in building ChunkRowIterator object is time consuming(More than 2 seconds).
Is there any suggestions for optimization?

issue code:
org.apache.carbondata.presto.CarbondataRecordSet

      public RecordCursor cursor() {
              ...
             CarbonIterator<Object[]> carbonIterator =
          new ChunkRowIterator((CarbonIterator<BatchResult>) queryExecutor.execute(queryModel));
             ...
      }