[jira] [Resolved] (CARBONDATA-4054) Size control of minor compaction

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-4054) Size control of minor compaction

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-4054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ajantha Bhat resolved CARBONDATA-4054.
--------------------------------------
    Fix Version/s: 2.2.0
       Resolution: Fixed

> Size control of minor compaction
> --------------------------------
>
>                 Key: CARBONDATA-4054
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4054
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: ZHANGSHUNYU
>            Priority: Major
>             Fix For: 2.2.0
>
>          Time Spent: 10h
>  Remaining Estimate: 0h
>
> {{Currentlly, minor compaction only consider the num of segments and major}}
> compaction only consider the SUM size of segments, but consider a scenario
>  that the user want to use minor compaction by the num of segments but he
>  dont want to merge the segment whose datasize larger the threshold for
>  example 2GB, as it is no need to merge so much big segment and it is time
>  costly.
>  so we need to add a parameter to control the threshold of segment included
>  in minor compaction, so that the user can specify the segment not included
>  in minor compaction once the datasize exeed the threshold, of course default
>  value must be threre.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)