[jira] [Commented] (CARBONDATA-1507) Dataload global sort fails with RpcTimeOutException: Futures timed out after [120 seconds]

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-1507) Dataload global sort fails with RpcTimeOutException: Futures timed out after [120 seconds]

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16175988#comment-16175988 ]

Mohammad Shahid Khan commented on CARBONDATA-1507:
--------------------------------------------------

This happening due to rdd unpersist  blocking calll. Sometime the RDD unpersist is not
happening in  default "spark.rp.askTimeout" or "spark.network.timeout" time.
Solution, we may make the unpersist call as non blocking. And doing this will not have any functional impact
as spark automatically monitors the cache usage on each node and drops out.

> Dataload global sort fails with RpcTimeOutException: Futures timed out after [120 seconds]
> ------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1507
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1507
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Mohammad Shahid Khan
>            Assignee: Mohammad Shahid Khan
>
> Dataload global sort fails with RpcTimeOutException: Futures timed out after [120 seconds]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)