[jira] [Created] (CARBONDATA-2836) Fixed data loading performance issue

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2836) Fixed data loading performance issue

Akash R Nilugal (Jira)
kumar vishal created CARBONDATA-2836:
----------------------------------------

             Summary: Fixed data loading performance issue
                 Key: CARBONDATA-2836
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2836
             Project: CarbonData
          Issue Type: Improvement
            Reporter: kumar vishal
            Assignee: kumar vishal


Problem: Data Loading is taking more time when number of records are high(3.5 billion) records

Root Cause: In case of Final merge sort temp row conversion is done in main thread because of this final step processing became slower.

Solution: Mode conversion logic to pre-fetch thread for parallel processing



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)