Posted by
GitBox on
Dec 17, 2020; 6:38am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/GitHub-carbondata-jack86596-opened-a-new-pull-request-4056-CARBONDATA-4090-After-compaction-interrup-tp104850.html
jack86596 opened a new pull request #4056:
URL:
https://github.com/apache/carbondata/pull/4056 …again and still fail, third time compaction can succeed but the new segment for SI table data size and index size is zero
### Why is this PR needed?
When compaction interrupted accidentally, the segment status is "Insert in Progress" and there will be stale files left in the new segment folder. Next time compaction will read the stale files. If some stale file is not complete, then compaction will fail always.
### What changes were proposed in this PR?
At the begining of compaction, segment folder should have no any stale files. So check the segment folder at the begining, if folder already exists, delete it and create it again.
### Does this PR introduce any user interface change?
- No
### Is any new testcase added?
- No
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[hidden email]