[jira] [Created] (CARBONDATA-2494) Improve Lucene datamap size and performnace.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2494) Improve Lucene datamap size and performnace.

Akash R Nilugal (Jira)
Ravindra Pesala created CARBONDATA-2494:
-------------------------------------------

             Summary: Improve Lucene datamap size and performnace.
                 Key: CARBONDATA-2494
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2494
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ravindra Pesala


Improved lucene datamap size and performance by using the following parameters.
New DM properties
`flush_cache`: size of the cache to maintain in Lucene writer, if specified then it tries to aggregate the unique data till the cache limit and flush to Lucene. It is best suitable for low cardinality dimensions.
`split_blocklet`: when made as true then store the data in blocklet wise in lucene , it means new folder will be created for each blocklet thus it eliminates storing on blockletid in lucene. And also it makes lucene small chunks of data.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)