carbontable compact throw err

[geda]

Hello:
in spark shell ,from carbonconext
cc.sql("ALTER TABLE test COMPACT 'MINOR'")
error happend.
how to sloved it ?


7/01/03 18:52:32 INFO CarbonDataRDDFactory$: main Acquired the compaction lock for table test
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 0
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 1
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 2
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 3
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 4
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 5
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 6
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 7
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 8
17/01/03 18:52:32 INFO CarbonDataRDDFactory$: main loads identified for merge is 9
17/01/03 18:52:32 INFO Compactor$: pool-26-thread-1 spark.executor.instances property is set to =20
17/01/03 18:52:32 INFO BlockBTreeBuilder: pool-26-thread-1 ************************Total Number Rows In BTREE: 1
17/01/03 18:52:32 INFO BlockBTreeBuilder: pool-26-thread-1 ************************Total Number Rows In BTREE: 1
17/01/03 18:52:32 INFO BlockBTreeBuilder: pool-26-thread-1 ************************Total Number Rows In BTREE: 1
17/01/03 18:52:32 INFO BlockBTreeBuilder: pool-26-thread-1 ************************Total Number Rows In BTREE: 1
17/01/03 18:52:32 ERROR CarbonDataRDDFactory$: main Exception in compaction thread java.io.IOException: java.lang.NullPointerException
17/01/03 18:52:32 ERROR CarbonDataRDDFactory$: main Exception in compaction thread java.io.IOException: java.lang.NullPointerException

[David CaiQiang]

You can check as following and show the result.

1)
select * from test limit 1

2)
show segments for table test limit 1000

3)
alter table test compact 'major'

Better to provide more log info.

[geda]

hello,1,2 is ok ,3 throw error

[Liang Chen]

OK, in next version: will consider add more test cases to test compaction function.
Anyway, thanks for you pointed out it, the error need to be reproduced, then can find out the reason.

Regards
Liang

geda wrote

hello,1,2 is ok ,3 throw error