[jira] [Resolved] (CARBONDATA-3367) OOM when huge number of carbondata files are read from SDK reader

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala resolved CARBONDATA-3367.
-----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.6.0

> OOM when huge number of carbondata files are read from SDK reader
> -----------------------------------------------------------------
>
>                 Key: CARBONDATA-3367
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3367
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Ajantha Bhat
>            Priority: Major
>             Fix For: 1.6.0
>
>          Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> Currently, for each carbondata file, one CarbonRecordReader will be created. And list of CarbonRecordReader will be maintained in carbonReader. so even when CarbonRecordReader is closed, the GC will not happen for that reader as list is still referring that object. 
> so, each CarbonRecordReader needs separate memory , instead of reusing the previous memory. 

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)