[GitHub] [carbondata] ajantha-bhat opened a new pull request #3729: [WIP] Allow force refresh table If table already exist in hive

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] ajantha-bhat opened a new pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox

ajantha-bhat opened a new pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729


    ### Why is this PR needed?
    Consider a scentio of upgrade from 1.6 carbon jars to 2.0,
   carbo.storelocation is s3a, but spark.sql.warehouse.dir is not configured.
   Once upgrade is done and refresh is performed. Latest 2.0 takes path from spark.sql.warehouse.dir, so hive table will have default fs warehouse location. Which is wrong location.
   
   So, need to allow user to configure spark.sql.warehouse.dir properly and do refresh again.
   But ew are not allowing refresh again as table already present in hive,
   
    ### What changes were proposed in this PR?
   Allow refresh again even if table exists in hive
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No
   
   
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox

CarbonDataQA1 commented on pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729#issuecomment-620390230


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2868/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729#issuecomment-620391258


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1153/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729#issuecomment-620679690


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1160/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729#issuecomment-620691288


   Build Failed  with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2875/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729#issuecomment-621152864


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2892/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3729: [WIP] Allow force refresh table If table already exist in hive

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3729:
URL: https://github.com/apache/carbondata/pull/3729#issuecomment-621158828


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1176/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]