RE: Proposal to integrate QATCodec into Carbondata

Posted by Xu, Cheng A on Oct 12, 2018; 6:47am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Proposal-to-integrate-QATCodec-into-Carbondata-tp64916p64942.html

Thanks Chuanyin. This PR looks cool. Allowing customized codec is a good option. Comparing with the existing built-in Snappy codec in CarbonData, I think QATCodec with better performance and better compression ratio is also a good candidate for built-in support. Any thoughts?

Thanks
Ferdinand Xu

-----Original Message-----
From: xuchuanyin [mailto:[hidden email]]
Sent: Friday, October 12, 2018 11:07 AM
To: [hidden email]
Subject: Re: Proposal to integrate QATCodec into Carbondata

emm, if it only needs to extend another compressor for software implementation, I think it will be quite easy to integrate.

Actually a PR has already been raised weeks ago to support customize compressor in carbondata, you can refer to this link:
https://github.com/apache/carbondata/pull/2715. You can refer to the `CustomizeCompressor` in `TestLoadDataWithCompression.scala` for more information.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/