[GitHub] [carbondata] ajithme opened a new pull request #3393: [CARBONDATA-3503][WIP][Carbon2] Adapt to SparkSessionExtension

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] ajithme opened a new pull request #3393: [CARBONDATA-3503][WIP][Carbon2] Adapt to SparkSessionExtension

GitBox
ajithme opened a new pull request #3393: [CARBONDATA-3503][WIP][Carbon2] Adapt to SparkSessionExtension
URL: https://github.com/apache/carbondata/pull/3393
 
 
   1. Use ``SparkSessionExtensions``
   2. Drop ``CarbonSessionCatalog`` and instead make it a utility by passing ``sparkSession`` as ``CarbonSessionCatalog``  
   3. ``SessionCatalog.lookupRelation`` do not provide across spark context synchronization
   3. Impact:
   
   Feature | Remarks
   ------------ | -------------
   MV | CarbonSession Only
   PreAggregate | CarbonSession Only
   Profiler | CarbonSession Only
   
   5. TODO:  
     a. Deprecate store and meta paths CARBONDATA-3510
   
   Existing tests must pass
   Added new testcase to extend spark session via extensions
   Split the Impact Features into CarbonSession and SparkSession testcases
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services