Liu Shaohui created CARBONDATA-1180:
---------------------------------------
Summary: Dictionary file id is locked for updation when loading data
Key: CARBONDATA-1180
URL:
https://issues.apache.org/jira/browse/CARBONDATA-1180 Project: CarbonData
Issue Type: Bug
Components: data-load
Affects Versions: 1.2.0
Reporter: Liu Shaohui
use Spark 2.1 in yarn-client mode and query from beeline to spark sql thriftserver
{code}
CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city string, age Int) STORED BY 'carbondata';
LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE carbondata_test;
{code}
Data load is failed for following exception.
{code}
java.lang.RuntimeException: Dictionary file id is locked for updation. Please try after some time +details
java.lang.RuntimeException: Dictionary file id is locked for updation. Please try after some time
at scala.sys.package$.error(package.scala:27)
at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:407)
at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:99)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{code}
The 1.2.0 contains the fix in CARBONDATA-614.
Any suggestion about this problem? Thanks~
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Locked
