[
https://issues.apache.org/jira/browse/CARBONDATA-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16571437#comment-16571437 ]
Prasanna Ravichandran commented on CARBONDATA-2822:
---------------------------------------------------
The property *"carbon.invisible.segments.preserve.count"* is actually for TableStatusFile only. When we set this property, if the number of invisible segments in tablestatus file exceeds that configured *carbon.invisible.segments.preserve.count value,* then it is moving all the invisible segments to the tablestatus.history file. It is working fine as expected.
> Carbon Configuration - "carbon.invisible.segments.preserve.count" configuration property is not working as expected.
> ---------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-2822
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-2822> Project: CarbonData
> Issue Type: Bug
> Components: core, file-format
> Environment: 3 Node ANT cluster.
> Reporter: Prasanna Ravichandran
> Priority: Minor
> Attachments: configuration.png
>
>
> For the *carbon.invisible.segments.preserve.count* configuration, it is not working as expected.
> +*Steps to reproduce:*+
> 1) Setting up "*carbon.invisible.segments.preserve.count=20"* in carbon.properties and restarting the thrift server.
>
> 2) After performing Loading 40 times and Compaction 4 times.
> 3) Perform clean files, so that the tablestatus.history file would be generated with invisible segments details.
> So Total 44 segments would be created including visible and invisible segments.(40 load segment (like segment ID from 0,1,2...39) + 4 compacted new segment(like 0.1,20.1,22.1,0.2))
> In that, *41 segments information are present in the "tablestatus.history" file(*which holds invisible(marked for delete and compacted) segments details) and 3 segments information are present in the "tablestatus" file(which holds visible segments(0 .2 -final compacted segment) along with (1^st^ segment - 0th segment) and (last segment-39th segment)). *But invisible segment preserve count is configured to 20, which is not followed for the tablestatus.history file.*
> +*Expected result:*+
> tablestatus.history file should preserve only the latest 20 segments, as per the configuration.
> +*Actual result:*+
> tablestatus.history file is having 41 invisible segments details.(which is above the configured value: 20)
>
> This is tested with ANT cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Locked
