Posted by
Xu, Cheng A on
Nov 01, 2018; 11:34am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Proposal-to-integrate-QATCodec-into-Carbondata-tp64916p67310.html
Thanks Raghu. Will prepare for the pull request.
Thanks
Ferdinand Xu
-----Original Message-----
From: Raghunandan S [mailto:
[hidden email]]
Sent: Thursday, November 1, 2018 7:09 PM
To:
[hidden email]
Subject: Re: Proposal to integrate QATCodec into Carbondata
+1
This would further enhance the performance of queries where io is the bottleneck
Regards
Raghu
On Fri, 12 Oct 2018, 12:18 pm Xu, Cheng A, <
[hidden email]> wrote:
> Thanks Chuanyin. This PR looks cool. Allowing customized codec is a
> good option. Comparing with the existing built-in Snappy codec in
> CarbonData, I think QATCodec with better performance and better
> compression ratio is also a good candidate for built-in support. Any thoughts?
>
> Thanks
> Ferdinand Xu
>
> -----Original Message-----
> From: xuchuanyin [mailto:
[hidden email]]
> Sent: Friday, October 12, 2018 11:07 AM
> To:
[hidden email]
> Subject: Re: Proposal to integrate QATCodec into Carbondata
>
> emm, if it only needs to extend another compressor for software
> implementation, I think it will be quite easy to integrate.
>
> Actually a PR has already been raised weeks ago to support customize
> compressor in carbondata, you can refer to this link:
>
https://github.com/apache/carbondata/pull/2715. You can refer to the
> `CustomizeCompressor` in `TestLoadDataWithCompression.scala` for more
> information.
>
>
>
> --
> Sent from:
>
http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.co> m/
>