[jira] [Resolved] (CARBONDATA-3787) MemoryLeak in data load and compaction

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ajantha Bhat resolved CARBONDATA-3787.
--------------------------------------
    Fix Version/s: 2.0.0
       Resolution: Fixed

> MemoryLeak in data load and compaction
> ---------------------------------------
>
>                 Key: CARBONDATA-3787
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3787
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Ajantha Bhat
>            Assignee: Kumar Vishal
>            Priority: Major
>             Fix For: 2.0.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Direct byte buffer used in #3638, which has memory leak
>  
> DirectByteBuffer are cleaned in offheap memory by JVM, when GC happens (when heap is full). Consider a scenario, where heap is not full, but offheap is getting full. In this case DirectByteBuffers is not cleaned as GC not happened. This time we may get OOM from offheap memory and yarn may kill the jvm process. So, it is better to clean up the DirectByteBuffers after the usage by calling a reflection method.

--
This message was sent by Atlassian Jira
(v8.3.4#803005)