[jira] [Created] (CARBONDATA-1212) Memory leak in case of compaction when unsafe is true

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1212) Memory leak in case of compaction when unsafe is true

Akash R Nilugal (Jira)
Manish Gupta created CARBONDATA-1212:
----------------------------------------

             Summary: Memory leak in case of compaction when unsafe is true
                 Key: CARBONDATA-1212
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1212
             Project: CarbonData
          Issue Type: Bug
            Reporter: Manish Gupta
            Assignee: Manish Gupta
             Fix For: 1.2.0
         Attachments: data.csv

In case of compaction, queryExecutor object is formed for multiple blocks but the objects are not retained and finish method is called only on the last instance created for query executor. Due to this the memory allocated to precious objects is not released which can lead to out of memory issue.

Steps to reproduce:
----------------------------------
CREATE TABLE IF NOT EXISTS t3 (ID Int, date Date, country String, name String, phonetype String, serialname char(10), salary Int) STORED BY 'carbondata' TBLPROPERTIES('DICTIONARY_EXCLUDE'='name')
LOAD DATA LOCAL INPATH 'data.csv' into table t3
LOAD DATA LOCAL INPATH 'data.csv' into table t3
alter table t3 compact 'major'




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)