[jira] [Updated] (CARBONDATA-3858) Increase the parallelism of CDC intermediate files processing

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xingjun Hao updated CARBONDATA-3858:
------------------------------------
    Summary: Increase the parallelism of CDC intermediate files processing  (was: Increase the parallelism of CDC deltafiles processing)

> Increase the parallelism of CDC intermediate files processing
> -------------------------------------------------------------
>
>                 Key: CARBONDATA-3858
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3858
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Xingjun Hao
>            Priority: Minor
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> In the CDC flow. the parallelism of deltafiles processing is the same as executor number, which reduce the parallelism heavily. The insufficient parallelism limits CPU overhead, hampers CDC's performance.

--
This message was sent by Atlassian Jira
(v8.3.4#803005)