[jira] [Commented] (CARBONDATA-80) Dictionary values should be equally distributed in buckets while loading in memory

Posted by Akash R Nilugal (Jira) on Aug 23, 2016; 2:03pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Commented-CARBONDATA-80-Dictionary-values-should-be-equally-distributed-in-buckets-while-loadiny-tp443.html


    [ https://issues.apache.org/jira/browse/CARBONDATA-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432839#comment-15432839 ]

ASF GitHub Bot commented on CARBONDATA-80:
------------------------------------------

Github user asfgit closed the pull request at:

    https://github.com/apache/incubator-carbondata/pull/44

> Dictionary values should be equally distributed in buckets while loading in memory
> ----------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-80
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-80
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>            Priority: Minor
>
> Whenever a query is executed, dictionary for columns queried is loaded in memory. For incremental loads dictionary values are loaded incrementally and thus one list contains several sub lists with dictionary values.
> The dictionary values on incremental load may not be equally distributed in the sub buckets and this might increase the search time of a value if there are too many incremental loads.
> Therefore the dictionary values should be divided equally in the sub buckets.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)