Re: Re: Delegation Token can be issued only with kerberos or web authentication" will occur in yarn cluster

Posted by yixu2001 on Nov 03, 2017; 1:40am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Delegation-Token-can-be-issued-only-with-kerberos-or-web-authentication-will-occur-in-yarn-cluster-tp25417p25479.html

dev 

 Our platform is installed with HDP 2.4, but spark 2.1 is not included in HDP 2.4, we using spark 2.1 with additional installed of apache version.

---

yixu2001

 

From: [hidden email]

Date: 2017-11-02 22:02

To: [hidden email]

Subject: Re: Re: Delegation Token can be issued only with kerberos or web authentication" will occur in yarn cluster

Hi yixu,

I am not able to see any attachment in your previous mail.

---

Regards,

Naresh P R

On Thu, Nov 2, 2017 at 4:40 PM, yixu2001 <[hidden email]> wrote:

dev 

 Please refer to the attachment "cluster carbon error2.txt" for the log trace.

In this log, I try 2 query statements:
select * from e_carbon.prod_inst_his       prod_inst_his is a hive table, it success.
select * from e_carbon.prod_inst_his_c     prod_inst_his_c is a carbon table, it failed.

I pass the principal in my start script, please refer to the attachment "testCluster.sh 

".

I have set hive.server2.enable.doAs = false in the above test and I have printed it in the log.

---

yixu2001

 

From: [hidden email]

Date: 2017-11-01 19:40

To: [hidden email]

Subject: Re: Delegation Token can be issued only with kerberos or web authentication" will occur in yarn cluster

Hi,

 

Ideally kerberos authentication should work with carbon table, Can you

share us log trace to analyze further more?

 

how are you passing the principal in yarn cluster ?

 

can you try to set hive.server2.enable.doAs = false & run query on carbon

table ?

----

Regards,

Naresh P R

 

On Wed, Nov 1, 2017 at 3:33 PM, yixu2001 <[hidden email]> wrote:

 

> dev

>  I submit a spark application in mode yarn cluster to a cluster with

> kerberos. In this application, it will successfully query a hive table, but

> when it try to query a carbon table, it failed with infomation "Delegation

> Token can be issued only with kerberos or web authentication".

>

> If I submit this application in mode yarn client, both hive table and

> carbon table will both success.

>

> And If I submit this application in mode yarn cluster on another cluster

> without kerberos, both hive table and carbon table will both success.

>

>

> yixu2001

>