[jira] [Created] (CARBONDATA-3617) loadDataUsingGlobalSort should based on SortColumns Instead Of Whole CarbonRow

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3617) loadDataUsingGlobalSort should based on SortColumns Instead Of Whole CarbonRow

Akash R Nilugal (Jira)
Xingjun Hao created CARBONDATA-3617:
---------------------------------------

             Summary: loadDataUsingGlobalSort should based on SortColumns Instead Of Whole CarbonRow
                 Key: CARBONDATA-3617
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3617
             Project: CarbonData
          Issue Type: Improvement
          Components: data-load
    Affects Versions: 1.6.1, 2.0.0
            Reporter: Xingjun Hao
             Fix For: 1.6.1, 2.0.0


During loading Data usesing globalsort, the sortby processing is based the whole carbon row, the overhead of gc is huge when there are many columns. Theoretically, the sortby processing can works well just based on the sort columns, which will brings less time overhead and gc overhead.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)