[jira] [Resolved] (CARBONDATA-3113) Fixed Local Dictionary Query Performance and Added reusable buffer for direct flow

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-3113) Fixed Local Dictionary Query Performance and Added reusable buffer for direct flow

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Manish Gupta resolved CARBONDATA-3113.
--------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.1

> Fixed Local Dictionary Query Performance  and Added reusable buffer for direct flow
> -----------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3113
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3113
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>            Priority: Major
>             Fix For: 1.5.1
>
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> 1. Added reusable buffer for direct flow
> In query for each page each column it is creating a byte array, when number of columns are high it is causing lots of minor gc and degrading query performance, as each page is getting uncompressed one by one we can use same buffer for all the columns and based on requested size it will resize.
> 2. Fixed Local Dictionary performance issue.
> Reverted back #2895 and fixed NPE issue by setting null for local dictionary to vector In safe and Unsafe VariableLengthDataChunkStore



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)