Re: user yarn needs the hdfs access when loading data?

Posted by Li Peng on Dec 28, 2016; 2:50am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/user-yarn-needs-the-hdfs-access-when-loading-data-tp5082p5144.html

Hi,
   1. I create carbon table in spark shell with user 'spark', the hdfs access of table store location  in hdfs is 755.
       Run a spark streaming application in yarn-cluster with user 'spark'.
       The application store dataframe to carbon table,  and 'carbon.ddl.base.hdfs.url' in carbon.properties is '/user/spark'.
       

   2. use carbondata 0.2.0 release.

 
   Why user 'yarn' must write access in  loading data?  I must use 'yarn' to create table and submit app now.


Thanks.