[Discussion] About syntax of compaction on specified segments

Posted by Jin Zhou on Mar 12, 2018; 2:31am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-About-syntax-of-compaction-on-specified-segments-tp41566.html

Hi, community:

I'm working on PR-1812
( https://github.com/apache/carbondata/pull/1812
<https://github.com/apache/carbondata/pull/1812>  )
which aims to support user specified segments in compaction operation.

After previous discussions， I think there are 3 possible ways to implement
the function:
1) Extending existing SQL syntax of Major and Minor compaciton:
    ALTER TABLE tablename compact 'MAJOR' '1, 2, 3, 4';
    ALTER TABLE tablename compact 'MINOR' '1, 2, 3, 4';

2) Adding support for CARBON_INPUT_SEGMENTS property of Major and Minor
compaciton:
    SET carbon.input.segments.dbname.tablename=1,3;
    ALTER TABLE tablename compact 'MAJOR';

3) Adding a new compaction type and some associated configs, for example,
'CUSTOM' :
    ALTER TABLE tablename compact 'CUSTOM' '1, 2, 3, 4'

I'm grateful for advice from chenliang,ravipesala and gvramana ,detailed
discussion history can be seen on web page:
( https://github.com/apache/carbondata/pull/1812
<https://github.com/apache/carbondata/pull/1812>  )

Now I'm a bit confused and really need your suggestion :)






--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/