[GitHub] [carbondata] jack86596 opened a new pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] jack86596 opened a new pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox

jack86596 opened a new pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056


   …again and still fail, third time compaction can succeed but the new segment for SI table data size and index size is zero
   
    ### Why is this PR needed?
   When compaction interrupted accidentally, the segment status is "Insert in Progress" and there will be stale files left in the new segment folder. Next time compaction will read the stale files. If some stale file is not complete, then compaction will fail always.
   
    ### What changes were proposed in this PR?
   At the begining of compaction, segment folder should have no any stale files. So check the segment folder at the begining, if folder already exists, delete it and create it again.
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-747246145


   Build Failed  with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3427/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-747246593


   Build Failed  with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5189/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-747312138


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5192/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-747315888


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3431/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-748003102


   Build Failed  with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/3291/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] marchpure commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

marchpure commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-748474039


   retest this please


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] jack86596 closed pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

jack86596 closed pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] jack86596 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

jack86596 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-748477692


   PR-3999 already fix the issue, close this PR.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-748485154


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12444/job/ApacheCarbonPRBuilder2.3/5214/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4056: [CARBONDATA-4090] After compaction interrupted accidentally, compact …

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4056:
URL: https://github.com/apache/carbondata/pull/4056#issuecomment-748485968


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12444/job/ApacheCarbon_PR_Builder_2.4.5/3454/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]