[jira] [Created] (CARBONDATA-861) Improvements in query processing.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-861) Improvements in query processing.

Akash R Nilugal (Jira)
Ravindra Pesala created CARBONDATA-861:
------------------------------------------

             Summary: Improvements in query processing.
                 Key: CARBONDATA-861
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-861
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ravindra Pesala
            Priority: Minor


Following are the list of can improvements done

Remove multiple creation of array and copy of it in Dimension and measure chunk readers.
Simplify logic of finding offsets of nodictionary keys in the class SafeVariableLengthDimensionDataChunkStore.
Avoid byte array creation and copy for nodictionary columns in case of vectorized reader. Instead directly sending the length and offset to vector.
Remove unnecessary decoder plan additions to oprtimized plan. It can optimize the codegen flow.
Update CompareTest to take table blocksize and kept as 32 Mb in order to make use of small sorting when doing take ordered in spark.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)