[GitHub] [carbondata] marchpure opened a new pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] marchpure opened a new pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

GitBox

marchpure opened a new pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796


   ### Why is this PR needed?
    when storing table status file in object store, reading of table status file mayfail (receive EOFException or JsonSyntaxException)
   when table status file is being modifying
   we shall retry multiple times and add the lock before throwing EOFException or JsonSyntaxException
   
    ### What changes were proposed in this PR?
   Add lock and retry mechanism to read tablestatus
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No
   
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647032458


   Build Failed  with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1452/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647032567


   Build Failed  with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3177/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] marchpure commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

GitBox
In reply to this post by GitBox

marchpure commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647069585


   retest this please


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647081587


   Build Failed  with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1454/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Lock and retry to read tablestatus before throwing …

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647081651


   Build Failed  with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3179/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [WIP] Lock and retry to read tablestatus before throwing …

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647097497


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3181/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [WIP] Lock and retry to read tablestatus before throwing …

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647097624


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1455/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Retry to read tablestatus before throwing EOFException or JsonSyntaxException or FileNotFoundException

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647156457


   Build Failed  with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3182/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Retry to read tablestatus before throwing EOFException or JsonSyntaxException

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647156922


   Build Failed  with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1456/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Retry to read tablestatus before throwing EOFException or JsonSyntaxException

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647171957


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3185/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3796: [CARBONDATA-3859] Retry to read tablestatus before throwing EOFException or JsonSyntaxException

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-647172066


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1459/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] jackylk commented on pull request #3796: [CARBONDATA-3859] Retry to read tablestatus before throwing EOFException or JsonSyntaxException

GitBox
In reply to this post by GitBox

jackylk commented on pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796#issuecomment-648199182


   LGTM


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] asfgit closed pull request #3796: [CARBONDATA-3859] Retry to read tablestatus before throwing EOFException or JsonSyntaxException

GitBox
In reply to this post by GitBox

asfgit closed pull request #3796:
URL: https://github.com/apache/carbondata/pull/3796


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]