Re: [Discussion] Merging carbonindex files for each segments and across segments

Posted by Liang Chen on Oct 26, 2017; 11:00am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-Merging-carbonindex-files-for-each-segments-and-across-segments-tp24441p24910.html

Yes, Jin Zhou.
Merge all index files to one in a segment would be useful feature. it would
significantly improve query performance.

Regards
Liang


Jin Zhou wrote

> Hi, ravipesala
>
> Thank you for your proposal, merging index file is a very useful feature
> as
> we have already met serious performance issue caused by too many index
> files
> (case 1).
>
> But I think the core problem of case 2 is too many loads which should be
> mainly considered in segment compaction part. As  "one segment one index
> file" design seems more clear and simple.
>
> Regards,
> Jin Zhou
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/