Login  Register

[1.5.2] Gzip Compression Support

Posted by shardul singh on Oct 12, 2018; 10:49am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/1-5-2-Gzip-Compression-Support-tp64960.html

Hi community,
Currently carbon supports SNAPPY and ZSTD codec. Proposing to add Gzip as
the compression codec offered by carbon.
Some benefits of having Gzip compression codec are :

   1. Gzip offers reduced file size compared to other codec like snappy but
   at the cost of processing speed.
   2. Gzip is suitable for users who have cold data i.e. data which which
   is stored permanently and will be queried rarely.

I have created the jira issue for the same.
https://issues.apache.org/jira/browse/CARBONDATA-3005 and will add the
design document there.
Any suggestions regarding this are welcomed by the community.

Regards,
Shardul