[jira] [Commented] (CARBONDATA-382) Like Filter Query Optimization for Dictionary Columns

[Akash R Nilugal (Jira)]

    [ https://issues.apache.org/jira/browse/CARBONDATA-382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637174#comment-15637174 ]

ASF GitHub Bot commented on CARBONDATA-382:
-------------------------------------------

GitHub user sujith71955 opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/296

    [CARBONDATA-382]Like Filter Query Optimization for Dictionary Columns

    **Like Filter Query Optimization for Dictionary Columns**
    a) Added pushdown mechanism for the Like filters like startsWith,endsWith and contains so that the respective filters will be processed in Carbon layer itself.
    b) This mechanism can provide significant gain in the performance of Like filter queries applied in the dictionary since block and blocklet level pruning will be done in the carbon layer before applying the filters in dictionary columns.
    c) Since three new expressions has been added in carbon layer the carbon will be applying the expression only once for startsWith/endsWith/contains filter query, this will make the dictionary lookup also once for applying the Like expression.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sujith71955/incubator-carbondata master_filterstartswith

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/296.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #296
   
----
commit 608906a25afc2bbabecfdd3c7bfa1351e83de9a0
Author: sujith71955 <[hidden email]>
Date:   2016-11-04T17:36:18Z

    [CARBONDATA-382]Like Filter Query Optimization for Dictionary Columns

----

> Like Filter Query Optimization for Dictionary Columns
> -----------------------------------------------------
>
>                 Key: CARBONDATA-382
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-382
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Sujith
>            Assignee: Sujith
>
> Like Filter Query Optimization for Dictionary Columns
> a) Added pushdown mechanism for the Like filters like startsWith,endsWith and contains so that the respective filters will be processed in Carbon layer itself.
> b) This mechanism can provide significant gain in the performance of Like filter queries applied in the dictionary since block and blocklet level pruning  will be done in the carbon layer before applying the filter.
> c) Since three new expressions has been added in carbon layer the carbon will be applying the expression only once for startsWith/endsWith/contains filter query, this will make the dictionary lookup also once for applying the expression.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)