Posted by
yixu2001 on
Apr 28, 2018; 10:40am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/COMPACT-error-tp46908p47345.html
dev
Logged in as: dr.who
Logs for container_e389_1523346903747_182411_01_000007
ResourceManager
RM Home
NodeManager
Tools
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/data08/nm-local-dirs/filecache/2608/spark2.1.1_jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.4.0.0-169/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See
http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The enable unsafe sort value "null" is invalid. Using the default value "true
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The custom block distribution value "null" is invalid. Using the default value "false
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The enable vector reader value "null" is invalid. Using the default value "true
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The value "LOCALLOCK" configured for key carbon.lock.type is invalid for current file system. Use the default value HDFSLOCK instead.
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The carbon task distribution value "null" is invalid. Using the default value "block
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The enable auto handoff value "null" is invalid. Using the default value "true
18/04/28 18:25:33 WARN CarbonProperties: Executor task launch worker for task 28 The specified value for property sort.inmemory.size.inmbis Invalid. Taking the default value.1024
18/04/28 18:25:35 WARN Client: Exception encountered while connecting to the server : org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby
18/04/28 18:25:35 WARN CarbonProperties: [Executor task launch worker for task 28][partitionID:cab;queryID:56345813895185751] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:36 WARN CarbonProperties: [Executor task launch worker for task 33][partitionID:cab;queryID:56345815252722993] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:38 WARN CarbonProperties: [Executor task launch worker for task 55][partitionID:cab;queryID:56345817033017122] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:39 WARN CarbonProperties: [Executor task launch worker for task 71][partitionID:cab;queryID:56345818201032258] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:41 WARN CarbonProperties: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:42 AUDIT CarbonFactDataHandlerColumnar: [hdd371][ip_crm][Thread-209]Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
18/04/28 18:25:42 AUDIT CarbonFactDataHandlerColumnar: [hdd371][ip_crm][Thread-134]{{java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.execute(RowResultMergerProcessor.java:168)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:228)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:60)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
18/04/28 18:25:42 ERROR CarbonMergerRDD: [Executor task launch worker for task 84][partitionID:cab;queryID:56345819695951602] Compaction Failed
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: {{java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.execute(RowResultMergerProcessor.java:168)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:228)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:60)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:333)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.execute(RowResultMergerProcessor.java:168)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.<init>(CarbonMergerRDD.scala:228)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD.internalCompute(CarbonMergerRDD.scala:84)
at org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:60)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
... 13 more
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
18/04/28 18:25:42 AUDIT CarbonFactDataHandlerColumnar: [hdd371][ip_crm][Thread-134]{{java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
18/04/28 18:25:42 ERROR TaskContextImpl: Error in TaskCompletionListener
org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: {{java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:333)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
... 16 more
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
18/04/28 18:25:42 ERROR Executor: Exception in task 108.0 in stage 0.0 (TID 84)
org.apache.spark.util.TaskCompletionListenerException: {{java.util.concurrent.ExecutionException: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processWriteTaskSubmitList(CarbonFactDataHandlerColumnar.java:329)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.closeHandler(CarbonFactDataHandlerColumnar.java:357)
at org.apache.carbondata.processing.merger.RowResultMergerProcessor.close(RowResultMergerProcessor.java:188)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1.org$apache$carbondata$spark$rdd$CarbonMergerRDD$$anon$$close(CarbonMergerRDD.scala:247)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:179)
at org.apache.carbondata.spark.rdd.CarbonMergerRDD$$anon$1$$anonfun$2.apply(CarbonMergerRDD.scala:178)
at org.apache.spark.TaskContext$$anon$1.onTaskCompletion(TaskContext.scala:123)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:97)
at org.apache.spark.TaskContextImpl$$anonfun$markTaskCompleted$1.apply(TaskContextImpl.scala:95)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:95)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.carbondata.core.datastore.exception.CarbonDataWriterException: Problem while writing the carbon data file: {{java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
}}
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:614)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:584)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 more
Caused by: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$TablePageList.get(CarbonFactDataHandlerColumnar.java:511)
at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Consumer.call(CarbonFactDataHandlerColumnar.java:602)
... 5 more
}}
at org.apache.spark.TaskContextImpl.markTaskCompleted(TaskContextImpl.scala:105)
at org.apache.spark.scheduler.Task.run(Task.scala:112)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
18/04/28 18:25:42 WARN CarbonProperties: [Executor task launch worker for task 120][partitionID:cab;queryID:56345821364343098] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:25:43 WARN CarbonProperties: [Executor task launch worker for task 133][partitionID:cab;queryID:56345822409462742] Configured value for property carbon.number.of.cores.while.loading is wrong. Falling back to the default value 2
18/04/28 18:26:15 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
yixu2001
From: manishgupta88
Date: 2018-04-27 13:39
To: dev
Subject: Re: COMPACT error
Hi,
From the exception it seems there is some problem during processing the data
in writer step.
Can you please share the complete executor and driver logs to get some idea
on the exact issue.
Regards
Manish Gupta
--
Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/