[jira] [Commented] (CARBONDATA-3880) How to start JDBC service in distributed index

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-3880) How to start JDBC service in distributed index

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17213825#comment-17213825 ]

Nihal kumar ojha commented on CARBONDATA-3880:
----------------------------------------------

Hi, please follow the below steps to configure the distributed index server with JDBC.

1. Add these properties in spark-defaults.conf
     spark.yarn.keytab=<spark-keytab file location>
     spark.carbon.indexserver.keytab=<spark-keytab file location>
     spark.carbon.indexserver.principal=spark2x/[hidden email]
     spark.yarn.principal=spark2x/[hidden email]

2. Add following configuration in carbon.properties(Ensure the carbon.properties is configured in spark-defaults.conf in driver extra java option)
     carbon.enable.index.server=true
     carbon.indexserver.enable.prepriming=true
     carbon.indexserver.HA.enabled=true
     carbon.max.executor.lru.cache.size=-1
     carbon.disable.index.server.fallback=false
     carbon.indexserver.zookeeper.dir=/indexserver2x
     carbon.index.server.port=<port no>

Then run below spark-submit command at $spark_home location
bin/spark-submit  --num-executors 2 --master yarn --class org.apache.carbondata.indexserver.indexserver <carbondata-spark jar location> <IP address>

then start spark JDBCserver as usual.
Queries should reflect in yarn UI, in the index server and spark JDBC application.
     

>  How to start JDBC service in distributed index
> -----------------------------------------------
>
>                 Key: CARBONDATA-3880
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3880
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 2.0.0
>            Reporter: li
>            Priority: Major
>             Fix For: 2.1.0
>
>
> How to start JDBC service in distributed index



--
This message was sent by Atlassian Jira
(v8.3.4#803005)