[jira] [Resolved] (CARBONDATA-3054) Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Manish Gupta resolved CARBONDATA-3054.
--------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.5.1

> Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen
> --------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3054
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3054
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Ajantha Bhat
>            Assignee: Ajantha Bhat
>            Priority: Major
>             Fix For: 1.5.1
>
>          Time Spent: 5h 20m
>  Remaining Estimate: 0h
>
> problem: In S3a environment, when quiried the data which has dictionary files,
> Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen even though file is present.
>  
> cause: CarbonDictionaryDecoder.doConsume() codeGen doesn't set hadoop conf in thread local variable, only doExecute() sets it.
> Hence, when getDictionaryWrapper() called from doConsume() codeGen,
> AbstractDictionaryCache.getDictionaryMetaCarbonFile() returns false for fileExists() operation.
>  
> solution:
> In CarbonDictionaryDecoder.doConsume() codeGen, set hadoop conf in thread local variable

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)