Re: [DISCUSSION] Implement file-level Min/Max index for streaming segment

Posted by sraghunandan on Aug 26, 2018; 6:33pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Implement-file-level-Min-Max-index-for-streaming-segment-tp60016p60396.html

+1. this would improve the query performance on streaming tables

On Sun, Aug 26, 2018 at 4:12 PM Liang Chen <[hidden email]> wrote:

> Hi
>
> +1 for this proposal.
>
> Regards
> Liang
>
>
> David CaiQiang wrote
> > Hi All,
> >     Currently, the filter queries on the streaming table always scan all
> > streaming files, even though there are no data in streaming files that
> > meet
> > the filter conditions.
> >     So I try to support file-level min/max index on streaming segment. It
> > helps to reduce the task number and improve the performance of filter
> scan
> > in some cases.
> >     Please check the document in JIRA:
> > https://issues.apache.org/jira/browse/CARBONDATA-2853
> > &lt;https://issues.apache.org/jira/browse/CARBONDATA-2853&gt;
> >     Any question, suggestion?
> >
> >
> >
> > -----
> > Best Regards
> > David Cai
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>