Login  Register

Re: Throw NullPointerException occasionally when query from stream table

Posted by xm_zzc on Nov 06, 2018; 9:53am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Throw-NullPointerException-occasionally-when-query-from-stream-table-tp66806p67900.html

Hi:
  The root cause is that when execute select sql, BlockDataMap will call
'SegmentPropertiesAndSchemaHolder.addSegmentProperties ' to add segment info
one by one, meanwhile if there are some segments updated, for example,
stream segment is handoff , handoff thread will call
'SegmentPropertiesAndSchemaHolder.invalidate' to delete segment info one by
one, if segmentIdAndSegmentPropertiesIndexWrapper.segmentIdSet.isEmpty() is
true, it will remove segmentPropertiesIndex, but select thread is still
using segmentPropertiesIndex to add/get segment info, and then NPE occur.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/