[jira] [Created] (CARBONDATA-3787) MemoryLeak in data load and compaction

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3787:
----------------------------------------

             Summary: MemoryLeak in data load and compaction
                 Key: CARBONDATA-3787
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3787
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Kumar Vishal


Direct byte buffer used in #3638, which has memory leak

 

DirectByteBuffer are cleaned in offheap memory by JVM, when GC happens (when heap is full). Consider a scenario, where heap is not full, but offheap is getting full. In this case DirectByteBuffers is not cleaned as GC not happened. This time we may get OOM from offheap memory and yarn may kill the jvm process. So, it is better to clean up the DirectByteBuffers after the usage by calling a reflection method.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)