[jira] [Updated] (CARBONDATA-1222) Residual files created from Update are not deleted after clean operation

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

panner selvam velmyl updated CARBONDATA-1222:
---------------------------------------------
    Description:
Spark - sql:

1.Create a table
create table t_carbn31(item_code string,item_name1 string) stored by 'carbondata'

2.Load Data
insert into t_carbn31 select 'a1','Phone';
insert into t_carbn31 select 'a2','Router';

3.Update the table
update t_carbn31 set(item_name1)=('Mobile') where item_code ='a1'
update t_carbn31 set(item_name1)=('USB') where item_code ='a2'
update t_carbn31 set(item_name1)=('General') where item_code !='a1'

4.Run clean files on the table
clean files for table t_carbn31

Expected output: clean files should remove the residual carbondata and delete files
Actual output : Residual files are not cleaned.

  was:
Spark - sql:

1.Create a table
create table t_carbn31(item_code string,item_name1 string) stored by 'carbondata'

2.Load Data
insert into t_carbn31 select 'a1','Phone';
insert into t_carbn31 select 'a2','Router';
3.Update the table
update t_carbn31 set(item_name1)=('Mobile') where item_code ='a1'
update t_carbn31 set(item_name1)=('USB') where item_code ='a2'
update t_carbn31 set(item_name1)=('General') where item_code !='a1'
4.Run clean files on the table
clean files for table t_carbn31

Expected output: clean files should remove the residual carbondata and delete files
Actual output : Residual files are not cleaned.

> Residual files created from Update are not deleted after clean operation
> ------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1222
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1222
>             Project: CarbonData
>          Issue Type: Bug
>          Components: spark-integration
>            Reporter: panner selvam velmyl
>            Priority: Minor
>   Original Estimate: 108h
>  Remaining Estimate: 108h
>
> Spark - sql:
> 1.Create a table
> create table t_carbn31(item_code string,item_name1 string) stored by 'carbondata'
> 2.Load Data
> insert into t_carbn31 select 'a1','Phone';
> insert into t_carbn31 select 'a2','Router';
> 3.Update the table
> update t_carbn31 set(item_name1)=('Mobile') where item_code ='a1'
> update t_carbn31 set(item_name1)=('USB') where item_code ='a2'
> update t_carbn31 set(item_name1)=('General') where item_code !='a1'
> 4.Run clean files on the table
> clean files for table t_carbn31
> Expected output: clean files should remove the residual carbondata and delete files
> Actual output : Residual files are not cleaned.

--
This message was sent by Atlassian JIRA
(v6.4.14#64029)