[jira] [Created] (CARBONDATA-2656) Presto Stream Readers performance Enhancement

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2656) Presto Stream Readers performance Enhancement

Akash R Nilugal (Jira)
Sourabh Verma created CARBONDATA-2656:
-----------------------------------------

             Summary: Presto Stream Readers performance Enhancement
                 Key: CARBONDATA-2656
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2656
             Project: CarbonData
          Issue Type: Improvement
          Components: presto-integration
    Affects Versions: 1.5.0
         Environment: Presto 0.187
            Reporter: Sourabh Verma
            Assignee: Sourabh Verma
             Fix For: 1.5.0


*Background*:

In the present system, we create carbonColumnVectorImpl object in carbonVectorbatch where carbon core fill up vector data (one by one) in column matched data type array, later which at the time presto block builder call, read by stream readers (based on data type) and iterated to fill up in block and returned to presto.

*Solution*:

We can eliminate the extra iteration over the carbonColumnVectorImpl object -> vectorArray, by extending it to create a directStreamReaders which will fill up carbon-core vector data (one by one) directly to the block(presto), and on the call of block builder it will return the block to the Presto.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)