[jira] [Created] (CARBONDATA-828) CarbonGlobalDictionaryGenerateRDD

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-828) CarbonGlobalDictionaryGenerateRDD

Akash R Nilugal (Jira)
tianli created CARBONDATA-828:
---------------------------------

             Summary: CarbonGlobalDictionaryGenerateRDD
                 Key: CARBONDATA-828
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-828
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
    Affects Versions: 1.0.0-incubating, 1.1.0-incubating
            Reporter: tianli
             Fix For: 1.1.0-incubating, 1.0.0-incubating
         Attachments: CarbonGlobalDictionaryRDD.scala

org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD find a bug:
    code line 378-380

if (model.isFirstLoad && model.highCardIdentifyEnable
&& !model.isComplexes(split.index)
&& model.dimensions(split.index).isColumnar) {

model.dimensions(split.index).isColumnar must change to  model.primDimensions(split.index).isColumnar because model.isComplexes.length may be != model.dimensions.length  when create table use DICTIONARY_EXCLUDE





--
This message was sent by Atlassian JIRA
(v6.3.15#6346)