[jira] [Commented] (CARBONDATA-363) Block loading issue in case of blocklet distribution

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-363) Block loading issue in case of blocklet distribution

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629677#comment-15629677 ]

ASF GitHub Bot commented on CARBONDATA-363:
-------------------------------------------

GitHub user kumarvishal09 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/280

    [CARBONDATA-363]fixed block loading issue in case of blocklet distribution

    **Problem**: In case of blocklet distribution same block is getting loaded multiple times this is because when blocklet distribution is enabled same block will divided inside a task so there is not synchronisation as block loading is done in different thread because of this same block is getting read from carbon data file footer multiple times and it is hitting the first time query performance.
    **Solution**: Need to add locking for above issue, if one thread is loading particulate block other thread need and once block loaded other thread need to use same reference of the block


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/kumarvishal09/incubator-carbondata blockloadingissue

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/280.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #280
   
----
commit a6d8a18a73e3ed8e39de444b2ddfded45813493f
Author: kumarvishal <[hidden email]>
Date:   2016-11-02T17:02:42Z

    fixed block loading issue in case of blocklet distribution

----


> Block loading issue in case of blocklet distribution
> ----------------------------------------------------
>
>                 Key: CARBONDATA-363
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-363
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: kumar vishal
>            Assignee: kumar vishal
>
> Problem: In case of blocklet distribution same block is getting loaded multiple times this is because when blocklet distribution is enabled same block will divided inside a task so there is not synchronisation as block loading is done in different thread because of this same block is getting read from carbon data file footer multiple times and it is hitting the first time query performance.
> Solution: Need to add locking for above issue, if one thread is loading particulate block other thread need and once block loaded other thread need to use same reference of the block



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)