Re: [DISCUSSION] CarbonData Integration with Presto

Posted by bhavya411 on Jul 10, 2017; 6:50am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-CarbonData-Integration-with-Presto-tp16793p17758.html

Hi Linquer,

I am  trying to run with the configuration that you suggested on 500 GB data , can you please verify the below properties.

config.queries

coordinator=true
node-scheduler.include-coordinator=true
http-server.http.port=8086
query.max-memory=5GB
#query.max-memory-per-node=1GB
discovery-server.enabled=true
discovery.uri=http://xx.xx.xx.xx:8086

jvm.config

-server
-Xmx16G
-XX:+UseG1GC
-XX:G1HeapRegionSize=32M
-XX:+UseGCOverheadLimit
-XX:+ExplicitGCInvokesConcurrent
-XX:+HeapDumpOnOutOfMemoryError
-XX:OnOutOfMemoryError=kill -9 %p
-XX:ReservedCodeCacheSize=1G

Regards

Bhavya

On Mon, Jul 3, 2017 at 11:45 AM, Bhavya Aggarwal <[hidden email]> wrote:

Thanks Linquer,

I will try with the above option and we tried it with ORC as well , here are the comparison results for same query with 50 GB of data and same configuration that I mentioned earlier.

Thanks and regards

Bhavya

On Mon, Jul 3, 2017 at 9:39 AM, linqer <[hidden email]> wrote:

Hi
1 you can set -XX:ReservedCodeCacheSize in JVM.propertes, make it big
2 I don't see your discovery.uri IP,  make user Master act as coordinate and
discovery server;
3 remove query.max-memory-per-node firstly.
4 you can test orc, parquet is not support very well on presto.

thanks



--
View this message in context: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/DISCUSSION-CarbonData-Integration-with-Presto-tp16793p17055.html

Sent from the Apache CarbonData Dev Mailing List archive mailing list archive at Nabble.com.