[jira] [Created] (CARBONDATA-3858) Increase the parallelism of CDC deltafiles processing

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3858) Increase the parallelism of CDC deltafiles processing

Akash R Nilugal (Jira)
Xingjun Hao created CARBONDATA-3858:
---------------------------------------

             Summary: Increase the parallelism of CDC deltafiles processing
                 Key: CARBONDATA-3858
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3858
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Xingjun Hao


In the CDC flow. the parallelism of deltafiles processing is the same as executor number, which reduce the parallelism heavily. The insufficient parallelism limits CPU overhead, hampers CDC's performance.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)