[jira] [Created] (CARBONDATA-3670) Support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3670) Support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.

Akash R Nilugal (Jira)
Xingjun Hao created CARBONDATA-3670:
---------------------------------------

             Summary: Support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.
                 Key: CARBONDATA-3670
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3670
             Project: CarbonData
          Issue Type: Wish
          Components: core
    Affects Versions: 2.0.0
            Reporter: Xingjun Hao
             Fix For: 2.0.0


When writing data, the columnpages are stored on the offheap,  the pages will be compressed to save storage cost. Now, in the compression processing, the data will be copied from the offheap to the heap before compressed, which leads to heavier GC overhead compared with compress offhead directly.

To sum up, we support compress offheap columnpage directly, avoding a copy of data from offhead to heap when compressed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)