[jira] [Created] (CARBONDATA-1484) carbonthriftserver cache is not refreshed

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1484) carbonthriftserver cache is not refreshed

Akash R Nilugal (Jira)
dylan created CARBONDATA-1484:
---------------------------------

             Summary: carbonthriftserver cache is not refreshed
                 Key: CARBONDATA-1484
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1484
             Project: CarbonData
          Issue Type: Bug
          Components: core
    Affects Versions: 1.1.0
         Environment: spark:1.6.0,mysql hive metastore
            Reporter: dylan
             Fix For: NONE


  i am use carbondata version is 1.1.0 and spark version is 1.6.0.
    and I reproduce in accordance with the official quick-start-guide case
again,
    1.Creating a Table
cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name
String,city String,age int) stored by 'carbondata' ")

    2.load data into table
  cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
table carbondb.test_table")

    3.start carbonthriftserver
   /home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit  --master local[*]
--driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties"
--executor-memory 4G  --driver-memory 2g  --conf
spark.serializer=org.apache.spark.serializer.KryoSerializer   --conf
"spark.sql.shuffle.partitions=3" --conf spark.speculation=true   --class
org.apache.carbondata.spark.thriftserver.CarbonThriftServer
/home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar
hdfs://nameservice1/user/zz/rp_carbon_store

   4.Connecting to CarbonData Thrift Server Using Beeline.

         <http://chuantu.biz/t6/47/1505284993x2890202558.jpg>

   5.drop table
   cc.sql("drop table carbondb.test_table")

   6.recreate table and load data
    cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name
String,city String,age int) stored by 'carbondata' ")
    cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
table carbondb.test_table")

   7.select data use beeline
    <http://chuantu.biz/t6/47/1505284937x1034817476.jpg>
   Like the above error, the cache is not updated

 in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is
one session on beeline,

and i test this case on the current carbondata master branch(1.2.0),

 when i use beeline there is no Btree load failed info,but in my table there
is no data,All the data is null,but in spark-shell is ok.
spark-shell:
+---+-----+--------+---+
| id| name|    city|age|
+---+-----+--------+---+
|  1|david|shenzhen| 31|
|  2|eason|shenzhen| 27|
|  3|jarry|   wuhan| 35|
+---+-----+--------+---+

beeline:
0: jdbc:hive2://localhost:10000> select * from  carbondb.test_table;
+-------+-------+-------+-------+--+
|  id   | name  | city  |  age  |
+-------+-------+-------+-------+--+
| NULL  | NULL  | NULL  | NULL  |
| NULL  | NULL  | NULL  | NULL  |
| NULL  | NULL  | NULL  | NULL  |
+-------+-------+-------+-------+--+



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)