[jira] [Created] (CARBONDATA-318) Implement an ExternalSorter that makes maximum usage of memory while sorting
Posted by
Akash R Nilugal (Jira) on
Oct 15, 2016; 5:37am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-318-Implement-an-ExternalSorter-that-makes-maximum-usage-of-memory-while-sorg-tp1957.html
Jacky Li created CARBONDATA-318:
-----------------------------------
Summary: Implement an ExternalSorter that makes maximum usage of memory while sorting
Key: CARBONDATA-318
URL:
https://issues.apache.org/jira/browse/CARBONDATA-318 Project: CarbonData
Issue Type: Sub-task
Reporter: Jacky Li
External Sorter should sort in memory until it reach configured size, then spill to disk. It should provide following interface:
1. insertRow/insertRowBatch: insert rows into the sorter
2. getIterator: return an iterator that iterate on sorted rows
External Sorter depends on FileWriterFactory to get a FileWriter to spill data into files. FileWriterFactory should be provided by user. Multiple implementations are possible, like writing into one folder or multiple folder
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)