[jira] [Created] (CARBONDATA-1837) Reusing old row to reduce memory consumption

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1837) Reusing old row to reduce memory consumption

Akash R Nilugal (Jira)
xuchuanyin created CARBONDATA-1837:
--------------------------------------

             Summary: Reusing old row to reduce memory consumption
                 Key: CARBONDATA-1837
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1837
             Project: CarbonData
          Issue Type: Improvement
          Components: data-load
            Reporter: xuchuanyin
            Assignee: xuchuanyin
            Priority: Minor


In data converting process of data loading, Carbondata will convert each row to another row by batch.

Currently, it will create a new batch to store the converted rows, which I think can be optimized to reuse the old row batch's space, thus will reduce memory consumption and GC overhead.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)