Hi community,
Configurations used for data compaction are as follows:
carbon.major.compaction.size
carbon.enable.auto.load.merge
carbon.compaction.level.threshold
carbon.numberof.preserve.segments
carbon.allowed.compaction.days
Configurations above are all global and in many circumstances are lack of
flexibility.
So I'd like to propose adding support of table level compaction
configuration.
The proposed way is to specify these compaction configs in CREATE TABLE
statement:
CREATE TABLE [IF NOT EXISTS] [db_name.]table_name
[(col_name data_type , ...)]
STORED BY 'carbondata'
[TBLPROPERTIES (major_compaction_size=1024, enable_auto_load_merge=false,
...)]
these configs are optional, if not specified, the global configs will be
used.
I've raised a jira issue,
https://issues.apache.org/jira/browse/CARBONDATA-1698<
https://issues.apache.org/jira/browse/CARBONDATA-1698>
--
Sent from:
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/