[jira] [Commented] (CARBONDATA-278) IS NULL and IS NOT NULL shall be push down to carbon

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-278) IS NULL and IS NOT NULL shall be push down to carbon

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15525831#comment-15525831 ]

ASF GitHub Bot commented on CARBONDATA-278:
-------------------------------------------

GitHub user sujith71955 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/202

    [CARBONDATA-278] IS NULL and IS NOT NULL shall be push down to carbon

    **Current design** : As per the current design IS NULL and IS NOT NULL filter is been handled by spark layer
    **Drawback** :  Block/Blocklet level pruning will not be possible if the filter is been processed by spark layer
    **Proposed Improvement**:  IS NULL and IS NOT NULL shall be push down to carbon layer since carbon layer can process these filters faster using block/block-let pruning , also while processing filters in executers  carbon is applying binary search for applying filter values.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sujith71955/incubator-carbondata master_filterOptimizations

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/202.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #202
   
----
commit b89510679237d12763bf99402ada60a675b6dfc2
Author: sujith71955 <[hidden email]>
Date:   2016-09-27T11:21:03Z

    [CARBONDATA-278] IS NULL and IS NOT NULL shall be push down to carbon layer since carbon layer can process these filters faster using block/block-let pruning ,
     also while processing filters in executors carbon is applying binary search for applying filter values.

----


> IS NULL and IS NOT NULL shall be push down to carbon
> ----------------------------------------------------
>
>                 Key: CARBONDATA-278
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-278
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Sujith
>            Assignee: Sujith
>            Priority: Minor
>
> IS NULL and IS NOT NULL shall be push down to carbon layer since carbon layer can process these filters faster using block/block-let pruning , also while processing filters in executers  carbon is applying binary search for applying filter values.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)