[jira] [Commented] (CARBONDATA-559) Job failed at last step

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-559) Job failed at last step

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15772502#comment-15772502 ]

Cao, Lionel commented on CARBONDATA-559:
----------------------------------------

The privilege of data path is appuser:appuser drwxr-xr-x.
And looks like the carbondata will use both [yarn, appuser] to write the data file/dictionary file/index file.
It is strange for this error occured because some time it doesn't return error.

> Job failed at last step
> -----------------------
>
>                 Key: CARBONDATA-559
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-559
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.2.0-incubating
>         Environment: carbon version: branch-0.2
> hadoop 2.4.0
> spark 1.6.0
> OS centOS
>            Reporter: Cao, Lionel
>         Attachments: test001.log.zip
>
>
> Hi team,
> My job alwasy failed at last step:
> it said 'yarn' user don't have write access to target data path(storeLocation).
> But I tested twice with 10000 rows data, both successed. could you help look into the log? Please refer to the attachment.
> Search 'access=WRITE' you can see the exception.
> Search 'Exception' for other exceptions.
> thanks,
> Lionel



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)