Ajantha Bhat created CARBONDATA-3570:
----------------------------------------
Summary: Incase of file format, task retry is having different task number, so file name is becoming different
Key: CARBONDATA-3570
URL:
https://issues.apache.org/jira/browse/CARBONDATA-3570 Project: CarbonData
Issue Type: Bug
Reporter: Ajantha Bhat
Assignee: Ajantha Bhat
problem : Incase of file format, task retry is having different task number, so file name is becoming different
cause : Everytime in executor, UUID is used to generate task number for carbondata file name. so if previous task has copied few files insted of all files and it got crashed. New task will create new file instead of overwriting existing file
solution: make task number in file name same for task retry by using taskid + job number
--
This message was sent by Atlassian Jira
(v8.3.4#803005)