[DISCUSSION] Implement file-level Min/Max index for streaming segment
Posted by David CaiQiang on Aug 23, 2018; 7:14am URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Implement-file-level-Min-Max-index-for-streaming-segment-tp60016.html
Hi All,
Currently, the filter queries on the streaming table always scan all
streaming files, even though there are no data in streaming files that meet
the filter conditions.
So I try to support file-level min/max index on streaming segment. It
helps to reduce the task number and improve the performance of filter scan
in some cases.
Please check the document in JIRA:
https://issues.apache.org/jira/browse/CARBONDATA-2853 <https://issues.apache.org/jira/browse/CARBONDATA-2853>
Any question, suggestion?