Krishna Reddy created CARBONDATA-144:
----------------------------------------
Summary: Minor compaction is not working
Key: CARBONDATA-144
URL:
https://issues.apache.org/jira/browse/CARBONDATA-144 Project: CarbonData
Issue Type: Bug
Components: data-query
Affects Versions: 0.1.0-incubating
Environment: SUSE11SP3, standalone application with Spark 1.5.2 and Hadoop 2.7.2 version
Reporter: Krishna Reddy
1. Create table
create table table1(column1 string, Amount int) STORED BY 'org.apache.carbondata.format'
2. Load the data for 10 times
3 . Run the Minor compaction query
alter table table compact 'Minor';
4. Verify the result
Minor compaction is not working
Driver Log:
16/08/05 14:54:07 ERROR CarbonDataRDDFactory$: Thread-1994 Exception in compaction thread java.lang.Exception: Compaction Failure in Merger Rdd.
Exception in thread "Thread-1994" java.util.concurrent.ExecutionException: java.lang.Exception: Compaction Failure in Merger Rdd.
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.carbondata.spark.rdd.CarbonDataRDDFactory$$anon$1$$anonfun$run$1.apply(CarbonDataRDDFactory.scala:366)
at org.carbondata.spark.rdd.CarbonDataRDDFactory$$anon$1$$anonfun$run$1.apply(CarbonDataRDDFactory.scala:365)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at org.carbondata.spark.rdd.CarbonDataRDDFactory$$anon$1.run(CarbonDataRDDFactory.scala:365)
Caused by: java.lang.Exception: Compaction Failure in Merger Rdd.
at org.carbondata.spark.rdd.Compactor$.triggerCompaction(Compactor.scala:151)
at org.carbondata.spark.rdd.Compactor.triggerCompaction(Compactor.scala)
at org.carbondata.integration.spark.merger.CompactionCallable.call(CompactionCallable.java:40)
at org.carbondata.integration.spark.merger.CompactionCallable.call(CompactionCallable.java:29)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Locked
