[
https://issues.apache.org/jira/browse/CARBONDATA-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570184#comment-16570184 ]
Indhumathi Muthumurugesh commented on CARBONDATA-2822:
------------------------------------------------------
Hi Prasanna,
The carbon configuration *"carbon.invisible.segments.preserve.count"* is actually for TableStatusFile. When set this property, if the number of invisible segment info files exceeds the given value, then, those files will be removed and written to tablestatus.history file.
Thanks & Regards,
Indhumathi M
> Carbon Configuration - "carbon.invisible.segments.preserve.count" configuration property is not working as expected.
> ---------------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-2822
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-2822> Project: CarbonData
> Issue Type: Bug
> Components: core, file-format
> Environment: 3 Node ANT cluster.
> Reporter: Prasanna Ravichandran
> Priority: Minor
>
> For the *carbon.invisible.segments.preserve.count* configuration, it is not working as expected.
> +*Steps to reproduce:*+
> 1) Setting up "*carbon.invisible.segments.preserve.count=20"* in carbon.properties and restarting the thrift server.
>
> 2) After performing Loading 40 times and Compaction 4 times.
> 3) Perform clean files, so that the tablestatus.history file would be generated with invisible segments details.
> So Total 44 segments would be created including visible and invisible segments.(40 load segment (like segment ID from 0,1,2...39) + 4 compacted new segment(like 0.1,20.1,22.1,0.2))
> In that, *41 segments information are present in the "tablestatus.history" file(*which holds invisible(marked for delete and compacted) segments details) and 3 segments information are present in the "tablestatus" file(which holds visible segments(0 .2 -final compacted segment) along with (1^st^ segment - 0th segment) and (last segment-39th segment)). *But invisible segment preserve count is configured to 20, which is not followed for the tablestatus.history file.*
> +*Expected result:*+
> tablestatus.history file should preserve only the latest 20 segments, as per the configuration.
> +*Actual result:*+
> tablestatus.history file is having 41 invisible segments details.(which is above the configured value: 20)
>
> This is tested with ANT cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Locked
