[jira] [Created] (CARBONDATA-3862) Insert stage performance optimazation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3862) Insert stage performance optimazation

Akash R Nilugal (Jira)
Xingjun Hao created CARBONDATA-3862:
---------------------------------------

             Summary: Insert stage performance optimazation
                 Key: CARBONDATA-3862
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3862
             Project: CarbonData
          Issue Type: New Feature
            Reporter: Xingjun Hao


There are two major performance bottlenecks of insert stage.

1) Get LastModifyTime of stagefiles requires a lot of access to OBS
2) Parallelism is not supported

Which shall be optimazed.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)