[jira] [Resolved] (CARBONDATA-2494) Improve Lucene datamap size and performnace.

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li resolved CARBONDATA-2494.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 1.4.0

> Improve Lucene datamap size and performnace.
> --------------------------------------------
>
>                 Key: CARBONDATA-2494
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2494
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Ravindra Pesala
>            Priority: Major
>             Fix For: 1.4.0
>
>          Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> Improved lucene datamap size and performance by using the following parameters.
> New DM properties
> `flush_cache`: size of the cache to maintain in Lucene writer, if specified then it tries to aggregate the unique data till the cache limit and flush to Lucene. It is best suitable for low cardinality dimensions.
> `split_blocklet`: when made as true then store the data in blocklet wise in lucene , it means new folder will be created for each blocklet thus it eliminates storing on blockletid in lucene. And also it makes lucene small chunks of data.

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)