[jira] [Resolved] (CARBONDATA-3026) clear expired property that may cause GC problem

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li resolved CARBONDATA-3026.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.1

> clear expired property that may cause GC problem
> ------------------------------------------------
>
>                 Key: CARBONDATA-3026
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3026
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>            Reporter: xuchuanyin
>            Assignee: xuchuanyin
>            Priority: Major
>             Fix For: 1.5.1
>
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> During data loading, we will write some temp files (sort temp
> files and temp fact data files) in some locations. In currently
> implementation, we will add the locations to the CarbonProperties and
> associated it with a special key that refers to the data loading.
> After data loading, the temp locations are cleared, but the added
> property is still remain in the CarbonProperties and never to be cleared.
> This will cause the CarbonProperties object growing bigger and bigger
> and lead to OOM problems if the thrift-server is a long time running
> service. A local test shows that after adding different properties for
> 11 Billion times, the OOM happens.

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)