[jira] [Created] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

Akash R Nilugal (Jira)
panner selvam velmyl created CARBONDATA-1222:
------------------------------------------------

             Summary: Residual files created from Update are not deleted after clean operation
                 Key: CARBONDATA-1222
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1222
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
            Reporter: panner selvam velmyl
            Priority: Minor


Spark - sql:

1.Create a table
create table t_carbn31(item_code string,item_name1 string) stored by 'carbondata'

2.Losd Data
insert into t_carbn31 select 'a1','Phone';

3.Update the table
update t_carbn01 set(item_name1)=('Mobile') where item_code ='a1'

4.Run clean files on the table
clean files for table t_carbn01

Expected output: clean files should remove the residual carbondata and delete files
Actual output : Residual files are not cleaned.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

chrmhrtsstr
Residual files left after update and clean operations in CarbonData often indicate gaps in segment cleanup and lifecycle management, where temporary artifacts are not fully tracked during post-update processing. The issue discussed in the CARBONDATA-1222 thread reflects this kind of behavior where residual files persist even after a clean operation, highlighting how distributed storage systems can miss cleanup triggers. This makes consistent housekeeping logic important to avoid storage bloat and stale data. Click here
lia
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

lia
In reply to this post by Akash R Nilugal (Jira)
Issues like residual files after update and incomplete cleanup in CarbonData reflect a wider pattern in distributed systems where temporary artifacts are not always removed properly, similar to how cached or leftover data can persist in app distribution environments. This is often seen in storage and lifecycle management challenges where cleanup processes need stronger consistency checks to avoid accumulation over time. The idea connects in a practical way with tools and platforms such as https://netmirror-apk.net/ where handling downloaded packages and leftover files also depends on proper cleanup behavior.
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

discusss
In reply to this post by Akash R Nilugal (Jira)
PvZ Fusion for PC download page sometimes comes up in gaming communities and links to https://pvzfusiondl.com/pvz-fusion-for-pc/ while discussions like CARBONDATA-1222 about residual files after update show the same core issue of cleanup after updates and installations affecting system stability and performance across software and games.
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

casee
In reply to this post by Akash R Nilugal (Jira)
Open source discussions often highlight the value of reliable testing with varied inputs. Using a https://randomcountrytool.com/ can help generate diverse country data for sample scenarios, making it easier to validate different use cases during development.