[jira] [Created] (CARBONDATA-3367) OOM when huge number of carbondata files are read from SDK reader

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3367:
----------------------------------------

             Summary: OOM when huge number of carbondata files are read from SDK reader
                 Key: CARBONDATA-3367
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3367
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat


Currently, for each carbondata file, one CarbonRecordReader will be created. And list of CarbonRecordReader will be maintained in carbonReader. so even when CarbonRecordReader is closed, the GC will not happen for that reader as list is still referring that object. 

so, each CarbonRecordReader needs separate memory , instead of reusing the previous memory. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)