[jira] [Commented] (CARBONDATA-241) OOM error during query execution in long run

[Akash R Nilugal (Jira)]

    [ https://issues.apache.org/jira/browse/CARBONDATA-241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492785#comment-15492785 ]

ASF GitHub Bot commented on CARBONDATA-241:
-------------------------------------------

GitHub user kumarvishal09 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/158

    [CARBONDATA-241]Fixed out of memory issue during query execution

    **Problem:** During long run query execution is taking more time and it is throwing out of memory issue.
    **Reason**: In compaction we are compacting segments and each segment metadata is loaded in memory. So after compaction compacted segments are invalid but its meta data is not removed from memory because of this duplicate metadata is pile up and it is taking more memory and after few days query execution is throwing OOM
    **Solution**: Need to remove invalid blocks from memory
   
     


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kumarvishal09/incubator-carbondata OOMIssue

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/158.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #158
   
----
commit 3ff39301df586597eebf3a8d92ca3c60f5eba531
Author: kumarvishal <[hidden email]>
Date:   2016-09-15T08:41:00Z

    Fixed out of memory issue during query execution

----

> OOM error during query execution in long run
> --------------------------------------------
>
>                 Key: CARBONDATA-241
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-241
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>
> **Problem:** During long run query execution is taking more time and it is throwing out of memory issue.
> **Reason**: In compaction we are compacting segments and each segment metadata is loaded in memory. So after compaction compacted segments are invalid but its meta data is not removed from memory because of this duplicate metadata is pile up and it is taking more memory and after few days query exeution is throwing OOM
> **Solution**: Need to remove invalid blocks from memory
>  

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)