Re: [DISCUSSION] Add new compaction type for compacting delta data file

Posted by Jacky Li on Mar 31, 2019; 2:56am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Add-new-compaction-type-for-compacting-delta-data-file-tp76597p76630.html

I guess your intention is to rewrite a single segment by merging base file and delta files to improve the query performance of that segment, right? I think this is doable and note that this operation may be time consuming since it is rewriting the whole segment.

Regards,
Jacky

> 在 2019年3月30日，上午10:36，xm_zzc <[hidden email]> 写道：
>
> Hi, Akash R:
>  thanks for your reply.
>  I am talking about the delta data files including update and delete delta
> files. Horizontal compaction just compacts all delta files into one in one
> segment, right? But if the size of segment is big and the size of update and
> delete delta file is big too, I think it will effect the query performance,
> because it needs to filter carbondata files and delta file, right?
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>