[jira] [Created] (CARBONDATA-1806) Carbon1.3.0 Load with global sort: Load fails If a table is created with sort scope as global sort

[Akash R Nilugal (Jira)]

Ajeet Rai created CARBONDATA-1806:
-------------------------------------

             Summary: Carbon1.3.0 Load with global sort: Load fails If a table is created with sort scope as global sort
                 Key: CARBONDATA-1806
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1806
             Project: CarbonData
          Issue Type: Bug
    Affects Versions: 1.3.0
         Environment: 3 node cluster
            Reporter: Ajeet Rai


Carbon1.3.0 Load with global sort: Load fails If a table is created with sort scope as global sort.

Steps:
1: create table dt1 (c1 string, c2 int) STORED BY 'org.apache.carbondata.format' tblproperties('sort_scope'='Global_sort');
2: LOAD DATA INPATH 'hdfs://hacluster/user/test/dt1.txt' INTO TABLE dt1 OPTIONS('DELIMITER'=',', 'QUOTECHAR'= '\"');
3: Observe that lod fails with error:
Error: java.lang.Exception: DataLoad failure (state=,code=0)
4: Check log:

org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException: There is an unexpected error: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException
        at org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:198)
        at org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:130)
        at org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:129)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
        at org.apache.spark.scheduler.Task.run(Task.scala:99)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        Suppressed: org.apache.spark.util.TaskCompletionListenerException: There is an unexpected error: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException

Previous exception in task: There is an unexpected error: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException
        org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:198)
        org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:130)
        org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:129)
        org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
        org.apache.spark.scheduler.Task.run(Task.scala:99)
        org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
        java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        java.lang.Thread.run(Thread.java:748)
                at org.apache.spark.TaskContextImpl.invokeListeners(TaskContextImpl.scala:138)
                at org.apache.spark.TaskContextImpl.markTaskFailed(TaskContextImpl.scala:106)
                at org.apache.spark.scheduler.Task.run(Task.scala:104)
                ... 4 more
Caused by: org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException
        at org.apache.carbondata.processing.loading.steps.DataWriterProcessorStepImpl.processingComplete(DataWriterProcessorStepImpl.java:163)
        at org.apache.carbondata.processing.loading.steps.DataWriterProcessorStepImpl.finish(DataWriterProcessorStepImpl.java:149)
        at org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:189)
        ... 8 more
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:326)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:350)
        at org.apache.carbondata.processing.loading.steps.DataWriterProcessorStepImpl.processingComplete(DataWriterProcessorStepImpl.java:160)
        ... 10 more
Caused by: java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:323)
        ... 12 more
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:630)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:601)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        ... 3 more



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)