Low Chin Wei created CARBONDATA-3554:
----------------------------------------
Summary: Zookeeper locking throw java.lang.IllegalArgumentException: Path cannot be null when running CLEAN FILES FOR TABLE
Key: CARBONDATA-3554
URL:
https://issues.apache.org/jira/browse/CARBONDATA-3554 Project: CarbonData
Issue Type: Bug
Components: core
Affects Versions: 1.6.0
Reporter: Low Chin Wei
when running CLEAN FILES FOR TABLE
It throws java.lang.IllegalArgumentException: Path cannot be null
at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:45) at org.apache.zookeeper.common.PathUtils.validatePath(PathUtils.java:45) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1081) at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1130) at org.apache.carbondata.core.locks.ZooKeeperLocking.unlock(ZooKeeperLocking.java:181) at org.apache.carbondata.core.util.DeleteLoadFolders.deleteLoadFoldersFromFileSystem(DeleteLoadFolders.java:252) at org.apache.carbondata.core.statusmanager.SegmentStatusManager.isUpdationRequired(SegmentStatusManager.java:927) at org.apache.carbondata.core.statusmanager.SegmentStatusManager.deleteLoadsAndUpdateMetadata(SegmentStatusManager.java:943) at org.apache.carbondata.api.CarbonStore$.cleanFiles(CarbonStore.scala:187) at org.apache.spark.sql.execution.command.management.CarbonCleanFilesCommand.cleanGarbageData(CarbonCleanFilesCommand.scala:147) at org.apache.spark.sql.execution.command.management.CarbonCleanFilesCommand.processData(CarbonCleanFilesCommand.scala:111) at org.apache.spark.sql.execution.command.AtomicRunnableCommand$$anonfun$run$3.apply(package.scala:148) at org.apache.spark.sql.execution.command.AtomicRunnableCommand$$anonfun$run$3.apply(package.scala:145) at org.apache.spark.sql.execution.command.Auditable$class.runWithAudit(package.scala:104) at org.apache.spark.sql.execution.command.AtomicRunnableCommand.runWithAudit(package.scala:141) at org.apache.spark.sql.execution.command.AtomicRunnableCommand.run(package.scala:145) at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult$lzycompute(commands.scala:70) at org.apache.spark.sql.execution.command.ExecutedCommandExec.sideEffectResult(commands.scala:68) at org.apache.spark.sql.execution.command.ExecutedCommandExec.executeCollect(commands.scala:79) at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190) at org.apache.spark.sql.Dataset$$anonfun$6.apply(Dataset.scala:190) at org.apache.spark.sql.Dataset$$anonfun$52.apply(Dataset.scala:3259) at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:77) at org.apache.spark.sql.Dataset.withAction(Dataset.scala:3258) at org.apache.spark.sql.Dataset.<init>(Dataset.scala:190) at org.apache.spark.sql.CarbonSession$$anonfun$sql$1.apply(CarbonSession.scala:91) at org.apache.spark.sql.CarbonSession$$anonfun$sql$1.apply(CarbonSession.scala:90) at org.apache.spark.sql.CarbonSession.withProfiler(CarbonSession.scala:136) at org.apache.spark.sql.CarbonSession.sql(CarbonSession.scala:88)
This is caused by this line of code in ZooKeeperLocking.java
if (null != zk.exists(lockPath, true)) {
It should check whether lockPath is not null:
if (null != lockPath && null != zk.exists(lockPath, true)) {
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Locked
