Re: update bug with carbondata1.1.0 and spark1.6.0

Posted by Erlu Chen on Jun 20, 2017; 2:46am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/update-bug-with-carbondata1-1-0-and-spark1-6-0-tp15578p15588.html

Hi

I Just test in my idea in local mode, I am not sure which mode and which branch you test.

I have tested and the result seems ok.

My test steps as follows:

1. just copy your code into CarbonExample class.
2. Run CarbonExample.


Pasted code as follows:

    import  cc.implicits._
    var kk:Seq[(String,String,String,Int)] = Nil
    for(i<-1 to 80000){
      kk = kk ++Seq((i+"", "name","city", i))
    }
    cc.sc.makeRDD(kk).toDF("id","name","city","age").registerTempTable("t1")
    cc.sql("DROP TABLE IF EXISTS testtable")
    cc.sql("CREATE TABLE IF NOT EXISTS testtable(id string, name string, city string, age Int) STORED BY 'carbondata'")
    cc.sql("insert INTO TABLE testtable select * from t1")

    cc.sql("SELECT count(distinct id) FROM testtable").show()

    cc.sql("""
         UPDATE testtable SET (testtable.name) = ('india') WHERE testtable.id = '10'
         """).show()

    cc.sql("SELECT count(distinct id) FROM testtable").show()

    cc.sql("""
        UPDATE testtable SET (testtable.name) = ('india') WHERE testtable.id = '10'
        """).show()

    cc.sql("SELECT count(distinct id) FROM testtable").show()

  }



 Test result as follows:

17/06/20 10:34:12 AUDIT CarbonDataRDDFactory$: [bogon][erlu][Thread-1]Data load request has been received for table default.testtable
17/06/20 10:34:16 AUDIT CarbonDataRDDFactory$: [bogon][erlu][Thread-1]Data load is successful for default.testtable
+-----+
|  _c0|
+-----+
|80000|
+-----+

17/06/20 10:34:28 AUDIT deleteExecution$: [bogon][erlu][Thread-1]Delete data operation is successful for default.testtable
17/06/20 10:34:28 AUDIT CarbonDataRDDFactory$: [bogon][erlu][Thread-1]Data load request has been received for table default.testtable
17/06/20 10:34:29 AUDIT CarbonDataRDDFactory$: [bogon][erlu][Thread-1]Data update is successful for default.testtable
++
||
++
++

+-----+
|  _c0|
+-----+
|80000|
+-----+

17/06/20 10:34:34 AUDIT deleteExecution$: [bogon][erlu][Thread-1]Delete data operation is successful for default.testtable
17/06/20 10:34:34 AUDIT CarbonDataRDDFactory$: [bogon][erlu][Thread-1]Data load request has been received for table default.testtable
17/06/20 10:34:34 AUDIT CarbonDataRDDFactory$: [bogon][erlu][Thread-1]Data update is successful for default.testtable
++
||
++
++

+-----+
|  _c0|
+-----+
|80000|
+-----+


Process finished with exit code 0


Correct me if I missing something important.


Regards.
Chenerlu.