[jira] [Updated] (CARBONDATA-3670) Support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-3670) Support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kunal Kapoor updated CARBONDATA-3670:
-------------------------------------
    Fix Version/s:     (was: 2.0.0)
                   2.1.0

> Support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3670
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3670
>             Project: CarbonData
>          Issue Type: Wish
>          Components: core
>    Affects Versions: 2.0.0
>            Reporter: Xingjun Hao
>            Priority: Minor
>             Fix For: 2.1.0
>
>          Time Spent: 4h 10m
>  Remaining Estimate: 0h
>
> When writing data, the columnpages are stored on the offheap,  the pages will be compressed to save storage cost. Now, in the compression processing, the data will be copied from the offheap to the heap before compressed, which leads to heavier GC overhead compared with compress offhead directly.
> To sum up, we support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)