[jira] [Created] (CARBONDATA-3244) Add benchmark for Change Data Capture scenario

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3244) Add benchmark for Change Data Capture scenario

Akash R Nilugal (Jira)
Jacky Li created CARBONDATA-3244:
------------------------------------

             Summary: Add benchmark for Change Data Capture scenario
                 Key: CARBONDATA-3244
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3244
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Jacky Li


CDC (change data capture) is a common scenario for analyzing slowly changed table in data warehouse.
It is good to add benchmark test comparing two update methods:
1. hive_solution, which uses INSERT OVERWRITE. This is a popular method for hive warehouse.
2. carbon_solution, which uses CarbonData's update syntax to update the history table directly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)