[DISCUSSION] Add new compaction type for compacting delta data file

Posted by xm_zzc on Mar 28, 2019; 4:31pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Add-new-compaction-type-for-compacting-delta-data-file-tp76597.html

Hi dev:
  Currently CarbonData supports using compaction command to compact delta
data into carbondata file, but it needs two or more segments to be
compacted, if the size of these segments is big and user don't want to
compact them(it needs to spend a lot of time), just want to compact delta
data files into carbondata files for every segment.
  Discuss with Jacky and David offline, there is a way to do this: add new
compaction type for compacting delta data files for each segment, for
example:
  alter table table_name compact 'iud_delta' where segment.id in (0.2), this
command will compact all delta data files of segment 0.2 into carbondata
files as new segment 0.3.

  Any suggestion for this, thanks.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/