Ravindra Pesala created CARBONDATA-2494:
-------------------------------------------
Summary: Improve Lucene datamap size and performnace.
Key: CARBONDATA-2494
URL:
https://issues.apache.org/jira/browse/CARBONDATA-2494 Project: CarbonData
Issue Type: Improvement
Reporter: Ravindra Pesala
Improved lucene datamap size and performance by using the following parameters.
New DM properties
`flush_cache`: size of the cache to maintain in Lucene writer, if specified then it tries to aggregate the unique data till the cache limit and flush to Lucene. It is best suitable for low cardinality dimensions.
`split_blocklet`: when made as true then store the data in blocklet wise in lucene , it means new folder will be created for each blocklet thus it eliminates storing on blockletid in lucene. And also it makes lucene small chunks of data.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)