Re: [proposal] Parallelize block pruning of default datamap in driver for filter query processing.

Posted by ravipesala on Nov 23, 2018; 5:55am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/proposal-Parallelize-block-pruning-of-default-datamap-in-driver-for-filter-query-processing-tp68660p68989.html

+1, It will be helpful for pruning millions of data files in less time.
Please try to generalize for all datamaps.

Thanks & Regards
Ravindra

On Fri, 23 Nov 2018 at 10:24, Ajantha Bhat <[hidden email]> wrote:

> @xuchuanyin
> Yes, I will be handling this for all types of datamap pruning in the same
> flow when I am done with default datamap's implementation and testing.
>
> Thanks,
> Ajantha
>
>
>
> On Fri, Nov 23, 2018 at 6:36 AM xuchuanyin <[hidden email]> wrote:
>
> > 'Parallelize pruning' is in my plan long time ago, nice to see your
> > proposal
> > here.
> >
> > While implementing this, I'd like you to make it common, that is to say
> not
> > only default datamap but also other index datamaps can also use
> parallelize
> > pruning.
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>

--
Thanks & Regards,
Ravi