[jira] [Commented] (CARBONDATA-1180) loading data failed for dictionary file id is locked for updation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-1180) loading data failed for dictionary file id is locked for updation

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053622#comment-16053622 ]

Liu Shaohui commented on CARBONDATA-1180:
-----------------------------------------

[~chenerlu]
Yes. I recreated tables and load the data for 3 times. I will encounter this issue every time.
{code}
CREATE TABLE IF NOT EXISTS carbondata_test3(id string, name string, city string, age Int) STORED BY 'carbondata';
LOAD DATA INPATH 'hdfs:///user/sql/sample-data/sample.csv' INTO TABLE carbondata_test3;
{code}


>  loading data failed for dictionary file id is locked for updation
> -------------------------------------------------------------------
>
>                 Key: CARBONDATA-1180
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1180
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 1.2.0
>            Reporter: Liu Shaohui
>
> use Spark 2.1 in yarn-client mode and query from beeline to spark sql thriftserver
> {code}
> CREATE TABLE IF NOT EXISTS carbondata_test(id string, name string, city string, age Int) STORED BY 'carbondata';
> LOAD DATA INPATH 'hdfs:///user/sample-data/sample.csv' INTO TABLE carbondata_test;
> {code}
> Data load is failed for following exception.
> {code}
> java.lang.RuntimeException: Dictionary file id is locked for updation. Please try after some time +details
> java.lang.RuntimeException: Dictionary file id is locked for updation. Please try after some time
> at scala.sys.package$.error(package.scala:27)
> at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:407)
> at org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:345)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
> at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
> at org.apache.spark.scheduler.Task.run(Task.scala:99)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:282)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> {code}
> The 1.2.0 contains the fix in CARBONDATA-614.
> Any suggestion about this problem? Thanks~



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)