Apache CarbonData Dev Mailing List archive › Apache CarbonData JIRA issues

[jira] [Updated] (CARBONDATA-639) "Delete data" feature doesn't work

classic Classic list List threaded Threaded
♦
♦
 1 message Options
Akash R Nilugal (Jira)
Reply | Threaded
Open this post in threaded view
♦
♦
|

[jira] [Updated] (CARBONDATA-639) "Delete data" feature doesn't work

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Liang Chen updated CARBONDATA-639:
----------------------------------
    Description:
1.Version:CarbonData is the latest master , Spark 1.6.2
2.Test Environment: spark-shell with command of ./bin/spark-shell --master local --jars ${carbondata_jar},${mysql_jar}

3.Reproduce steps:
1.Finish load data , query as below : cc.sql("select * from connectdemo1 where age > 40").show() :
+------+------+--------+-------+---+
|  name|gender|province|singler|age|
+------+------+--------+-------+---+
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 51|
|Abbott|Female|      AB|  false| 65|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 56|
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 58|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 49|
|Abbott|Female|      AB|  false| 53|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 48|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 49|
+------+------+--------+-------+---+

cc.sql("select count(*) from connectdemo1").show()

+-------+
|    _c0|
+-------+
|9000000|
+-------+

2.cc.sql("delete from connectdemo1 where age > 60").show

3.query again with cc.sql("select * from connectdemo1 where age > 40").show() and cc.sql("select count(*) from connectdemo1").show()  : same result with before deletion , so the delete operation is failed.

+------+------+--------+-------+---+
|  name|gender|province|singler|age|
+------+------+--------+-------+---+
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 51|
|Abbott|Female|      AB|  false| 65|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 56|
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 58|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 49|
|Abbott|Female|      AB|  false| 53|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 48|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 49|
+------+------+--------+-------+---+

+-------+
|    _c0|
+-------+
|9000000|
+-------+


  was:
Reproduce steps:
1.Finish load data , query as below : cc.sql("select * from connectdemo1 where age > 40").show() :
+------+------+--------+-------+---+
|  name|gender|province|singler|age|
+------+------+--------+-------+---+
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 51|
|Abbott|Female|      AB|  false| 65|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 56|
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 58|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 49|
|Abbott|Female|      AB|  false| 53|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 48|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 49|
+------+------+--------+-------+---+

cc.sql("select count(*) from connectdemo1").show()

+-------+
|    _c0|
+-------+
|9000000|
+-------+

2.cc.sql("delete from connectdemo1 where age > 60").show

3.query again with cc.sql("select * from connectdemo1 where age > 40").show() and cc.sql("select count(*) from connectdemo1").show()  : same result with before deletion , so the delete operation is failed.

+------+------+--------+-------+---+
|  name|gender|province|singler|age|
+------+------+--------+-------+---+
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 51|
|Abbott|Female|      AB|  false| 65|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 56|
|Abbott|Female|      AB|  false| 54|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 58|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 47|
|Abbott|Female|      AB|  false| 49|
|Abbott|Female|      AB|  false| 53|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 48|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 52|
|Abbott|Female|      AB|  false| 62|
|Abbott|Female|      AB|  false| 61|
|Abbott|Female|      AB|  false| 63|
|Abbott|Female|      AB|  false| 49|
+------+------+--------+-------+---+

+-------+
|    _c0|
+-------+
|9000000|
+-------+



> "Delete data" feature doesn't work
> ----------------------------------
>
>                 Key: CARBONDATA-639
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-639
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.0.0-incubating
>            Reporter: Liang Chen
>             Fix For: 1.0.0-incubating
>
>
> 1.Version:CarbonData is the latest master , Spark 1.6.2
> 2.Test Environment: spark-shell with command of ./bin/spark-shell --master local --jars ${carbondata_jar},${mysql_jar}
> 3.Reproduce steps:
> 1.Finish load data , query as below : cc.sql("select * from connectdemo1 where age > 40").show() :
> +------+------+--------+-------+---+
> |  name|gender|province|singler|age|
> +------+------+--------+-------+---+
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 51|
> |Abbott|Female|      AB|  false| 65|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 56|
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 58|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 49|
> |Abbott|Female|      AB|  false| 53|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 48|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 49|
> +------+------+--------+-------+---+
> cc.sql("select count(*) from connectdemo1").show()
> +-------+
> |    _c0|
> +-------+
> |9000000|
> +-------+
> 2.cc.sql("delete from connectdemo1 where age > 60").show
> 3.query again with cc.sql("select * from connectdemo1 where age > 40").show() and cc.sql("select count(*) from connectdemo1").show()  : same result with before deletion , so the delete operation is failed.
> +------+------+--------+-------+---+
> |  name|gender|province|singler|age|
> +------+------+--------+-------+---+
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 51|
> |Abbott|Female|      AB|  false| 65|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 56|
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 58|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 49|
> |Abbott|Female|      AB|  false| 53|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 48|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 49|
> +------+------+--------+-------+---+
> +-------+
> |    _c0|
> +-------+
> |9000000|
> +-------+



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Free forum by Nabble Edit this page