[jira] [Created] (CARBONDATA-4027) Fix the wrong modifiedtime of loading files in insert stage

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-4027) Fix the wrong modifiedtime of loading files in insert stage

Akash R Nilugal (Jira)
Xingjun Hao created CARBONDATA-4027:
---------------------------------------

             Summary: Fix the wrong modifiedtime of loading files in insert stage
                 Key: CARBONDATA-4027
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4027
             Project: CarbonData
          Issue Type: Bug
            Reporter: Xingjun Hao


In the insertstage flow, there is a empty file with suffix '.loading' to mark the stage in the status of 'in processing'. We update the modifiedtime of '.loading' file for monitoring the insertstage start time, which can be used for calculate TIMEOUT, help to retry and recovery.

Before, we use setModifiedTime function to update the modifiedtime, which has a serious bug.

For S3 file, setModifiedTime operation do not take effect. leading to the incorrect inserstage starttime of 'loading' file.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)