Posted by
xm_zzc on
Oct 31, 2018; 7:08am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Throw-NullPointerException-occasionally-when-query-from-stream-table-tp66806p67098.html
Hi:
I added some logs to trace this problem, found that when call
BlockDataMap.getFileFooterEntrySchema, the key 'segmentPropertiesIndex'
which was stored in BlockDataMap instance was removed by other thread from
SegmentPropertiesAndSchemaHolder.indexToSegmentPropertiesWrapperMapping :
2018-10-31 14:49:24,967
datastore.block.SegmentPropertiesAndSchemaHolder.addSegmentProperties(SegmentPropertiesAndSchemaHolder.java:115)
Thread-39 -========put 37 into indexToSegmentPropertiesWrapperMapping 0
2018-10-31 14:49:25,472
datastore.block.SegmentPropertiesAndSchemaHolder.invalidate(SegmentPropertiesAndSchemaHolder.java:243)
Executor task launch worker for task 926 -========remove 37 out of
indexToSegmentPropertiesWrapperMapping 31
2018-10-31 14:49:25,486
indexstore.blockletindex.BlockDataMap.getFileFooterEntrySchema(BlockDataMap.java:1002)
Thread-39 -========get 37 null
the key segmentPropertiesIndex=37 was removed at 2018-10-31 14:49:25,472.2018-10-31 14:56:45,057
datastore.block.SegmentPropertiesAndSchemaHolder.addSegmentProperties(SegmentPropertiesAndSchemaHolder.java:115)
Thread-39 -========put 98 into indexToSegmentPropertiesWrapperMapping 0
2018-10-31 14:56:45,477
datastore.block.SegmentPropertiesAndSchemaHolder.invalidate(SegmentPropertiesAndSchemaHolder.java:243)
Executor task launch worker for task 2653 -========remove 98 out of
indexToSegmentPropertiesWrapperMapping 67
2018-10-31 14:56:46,290
indexstore.blockletindex.BlockDataMap.getFileFooterEntrySchema(BlockDataMap.java:1002)
Thread-39 -========get 98 null
2018-10-31 14:56:51,392
indexstore.blockletindex.BlockDataMap.getFileFooterEntrySchema(BlockDataMap.java:1002)
Thread-39 -========get 98 null
--
Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/