[jira] [Created] (CARBONDATA-3054) Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3054:
----------------------------------------

             Summary: Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen
                 Key: CARBONDATA-3054
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3054
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


problem: In S3a environment, when quiried the data which has dictionary files,

Dictionary file cannot be read in S3a with CarbonDictionaryDecoder.doConsume() codeGen even though file is present.

 

cause: CarbonDictionaryDecoder.doConsume() codeGen doesn't set hadoop conf in thread local variable, only doExecute() sets it.

Hence, when getDictionaryWrapper() called from doConsume() codeGen,

AbstractDictionaryCache.getDictionaryMetaCarbonFile() returns false for fileExists() operation.

 

solution:

In CarbonDictionaryDecoder.doConsume() codeGen, set hadoop conf in thread local variable



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)