[ https://issues.apache.org/jira/browse/CARBONDATA-363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629677#comment-15629677 ] ASF GitHub Bot commented on CARBONDATA-363: ------------------------------------------- GitHub user kumarvishal09 opened a pull request: https://github.com/apache/incubator-carbondata/pull/280 [CARBONDATA-363]fixed block loading issue in case of blocklet distribution **Problem**: In case of blocklet distribution same block is getting loaded multiple times this is because when blocklet distribution is enabled same block will divided inside a task so there is not synchronisation as block loading is done in different thread because of this same block is getting read from carbon data file footer multiple times and it is hitting the first time query performance. **Solution**: Need to add locking for above issue, if one thread is loading particulate block other thread need and once block loaded other thread need to use same reference of the block You can merge this pull request into a Git repository by running: $ git pull https://github.com/kumarvishal09/incubator-carbondata blockloadingissue Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-carbondata/pull/280.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #280 ---- commit a6d8a18a73e3ed8e39de444b2ddfded45813493f Author: kumarvishal <[hidden email]> Date: 2016-11-02T17:02:42Z fixed block loading issue in case of blocklet distribution ---- > Block loading issue in case of blocklet distribution > ---------------------------------------------------- > > Key: CARBONDATA-363 > URL: https://issues.apache.org/jira/browse/CARBONDATA-363 > Project: CarbonData > Issue Type: Bug > Reporter: kumar vishal > Assignee: kumar vishal > > Problem: In case of blocklet distribution same block is getting loaded multiple times this is because when blocklet distribution is enabled same block will divided inside a task so there is not synchronisation as block loading is done in different thread because of this same block is getting read from carbon data file footer multiple times and it is hitting the first time query performance. > Solution: Need to add locking for above issue, if one thread is loading particulate block other thread need and once block loaded other thread need to use same reference of the block -- This message was sent by Atlassian JIRA (v6.3.4#6332) |
Free forum by Nabble | Edit this page |