[jira] [Commented] (CARBONDATA-4074) Should clean stale data in success segments

Posted by Akash R Nilugal (Jira) on Mar 05, 2021; 10:07am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Commented-CARBONDATA-4074-Should-clean-stale-data-in-success-segments-tp106547.html


    [ https://issues.apache.org/jira/browse/CARBONDATA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17295933#comment-17295933 ]

SHREELEKHYA GAMPA commented on CARBONDATA-4074:
-----------------------------------------------

can also include,

4. clean stale index files 

5. clean stale segment files

with retention time.

> Should clean stale data in success segments
> -------------------------------------------
>
>                 Key: CARBONDATA-4074
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4074
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: David Cai
>            Priority: Major
>
> cleaning stale data in success segments include the following parts. 
> 1.  clean stale delete delta (when force is true)
> 2. clean stale small  files for index table
> 3. clean stale data files for loading/compaction

--
This message was sent by Atlassian Jira
(v8.3.4#803005)