[jira] [Created] (CARBONDATA-3570) Incase of file format, task retry is having different task number, so file name is becoming different

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3570) Incase of file format, task retry is having different task number, so file name is becoming different

Akash R Nilugal (Jira)
Ajantha Bhat created CARBONDATA-3570:
----------------------------------------

             Summary:  Incase of file format, task retry is having different task number, so file name is becoming different
                 Key: CARBONDATA-3570
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3570
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


problem :  Incase of file format, task retry is having different task number, so file name is becoming different

cause : Everytime in executor, UUID is used to generate task number for carbondata file name. so if previous task has copied few files insted of all files and it got crashed. New task will create new file instead of overwriting existing file

 

solution: make task number in file name same for task retry by using taskid + job number



--
This message was sent by Atlassian Jira
(v8.3.4#803005)