ravipesala commented on issue #3483: [CARBONDATA-3597] Support Merge for SCD and CCD scenarios
URL:
https://github.com/apache/carbondata/pull/3483#issuecomment-560201339
1. Yes, we can but provided the source columns name and datatype should match the target table column names and datatype. I will handle it during the supporting SQL syntax PR.
2. What I have tested is the most common scenario in the banking domain. And yes I have verified with a tall table as well it will be around 1.3~1.5X improvement based on how thin the table is.
3. It is not just about parquet and carbon comparison, it is about the method of how we achieve SCD and CCD scenarios. And yes we get most performance gain in terms of avoiding shuffling and rewriting of entire partitions.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[hidden email]
With regards,
Apache Git Services
Locked
