[jira] [Commented] (CARBONDATA-639) "Delete data" feature doesn't work

[Akash R Nilugal (Jira)]

    [ https://issues.apache.org/jira/browse/CARBONDATA-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15823537#comment-15823537 ]

Liang Chen commented on CARBONDATA-639:
---------------------------------------

Version: CarbonData is the latest master + Spark 1.6.2

go to SPARK_HOME, start up spark-shell:
spark-shell with command : ./bin/spark-shell --master local --jars ${carbondata_jar},${mysql_jar}     (note:need to configure mysql as metadata database)

Create table
cc.sql(“CREATE TABLE connectdemo1 (name String, gender String, province String , singler String, age Int) STORED BY ‘org.apache.carbondata.format’”)
(you can simulate data as per the below)
Abbott Female AB false 54
Abbott Female AB false 51
Abbott Female AB false 65
Abbott Female AB false 47
Abbott Female AB false 56
Abbott Female AB false 54
Abbott Female AB false 61
Abbott Female AB false 58
Abbott Female AB false 62
Abbott Female AB false 47
Abbott Female AB false 49
Abbott Female AB false 53
Abbott Female AB false 63
Abbott Female AB false 48
Abbott Female AB false 52
Abbott Female AB false 52
Abbott Female AB false 62
Abbott Female AB false 61
Abbott Female AB false 63
Abbott Female AB false 49


cc.sql(“LOAD DATA LOCAL INPATH ‘csv file data’”)

> "Delete data" feature doesn't work
> ----------------------------------
>
>                 Key: CARBONDATA-639
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-639
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.0.0-incubating
>            Reporter: Liang Chen
>            Assignee: sounak chakraborty
>             Fix For: 1.0.0-incubating
>
>
> 1.Version:CarbonData is the latest master , Spark 1.6.2
> 2.Test Environment: spark-shell with command of ./bin/spark-shell --master local --jars ${carbondata_jar},${mysql_jar}
> 3.Reproduce steps:
> 1.Finish load data , query as below : cc.sql("select * from connectdemo1 where age > 40").show() :
> +------+------+--------+-------+---+
> |  name|gender|province|singler|age|
> +------+------+--------+-------+---+
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 51|
> |Abbott|Female|      AB|  false| 65|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 56|
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 58|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 49|
> |Abbott|Female|      AB|  false| 53|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 48|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 49|
> +------+------+--------+-------+---+
> cc.sql("select count(*) from connectdemo1").show()
> +-------+
> |    _c0|
> +-------+
> |9000000|
> +-------+
> 2.cc.sql("delete from connectdemo1 where age > 60").show
> 3.query again with cc.sql("select * from connectdemo1 where age > 40").show() and cc.sql("select count(*) from connectdemo1").show()  : same result with before deletion , so the delete operation is failed.
> +------+------+--------+-------+---+
> |  name|gender|province|singler|age|
> +------+------+--------+-------+---+
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 51|
> |Abbott|Female|      AB|  false| 65|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 56|
> |Abbott|Female|      AB|  false| 54|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 58|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 47|
> |Abbott|Female|      AB|  false| 49|
> |Abbott|Female|      AB|  false| 53|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 48|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 52|
> |Abbott|Female|      AB|  false| 62|
> |Abbott|Female|      AB|  false| 61|
> |Abbott|Female|      AB|  false| 63|
> |Abbott|Female|      AB|  false| 49|
> +------+------+--------+-------+---+
> +-------+
> |    _c0|
> +-------+
> |9000000|
> +-------+

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)