[Discussion]support table level compaction configuration

[Jin Zhou]

Hi community,

Configurations used for data compaction are as follows:
carbon.major.compaction.size
carbon.enable.auto.load.merge
carbon.compaction.level.threshold
carbon.numberof.preserve.segments
carbon.allowed.compaction.days

Configurations above are all global and in many circumstances are lack of
flexibility.
So I'd like to propose adding support of table level compaction
configuration.

The proposed way is to specify these compaction configs in CREATE TABLE
statement:

   CREATE TABLE [IF NOT EXISTS] [db_name.]table_name
                    [(col_name data_type , ...)]
   STORED BY 'carbondata'
   [TBLPROPERTIES (major_compaction_size=1024, enable_auto_load_merge=false,
...)]

these configs are optional, if not specified, the global configs will be
used.

I've raised a jira issue,
https://issues.apache.org/jira/browse/CARBONDATA-1698
<https://issues.apache.org/jira/browse/CARBONDATA-1698>  





--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[xm_zzc]

It's a good suggestion. Do you start to working on this?



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Jin Zhou]

@xm_zzc, yes, I'm working on this improvement.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Liang Chen]

Hi Jin Zhou

Look forward to seeing your pull request.
Do you have the contributor right of Apache CarbonData JIRA?
If no, please let me know your email id of jira account.

Regards
Liang


Jin Zhou wrote
> @xm_zzc, yes, I'm working on this improvement.
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/





--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Jin Zhou]

@Liang Chen

I have no contributor right of Apache CarbonData JIRA now.
My email id of jira account is:  xaprice at yeah dot net



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/