[jira] [Resolved] (CARBONDATA-1484) carbonthriftserver cache is not refreshed

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-1484) carbonthriftserver cache is not refreshed

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-1484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li resolved CARBONDATA-1484.
----------------------------------
    Resolution: Fixed

> carbonthriftserver cache is not refreshed
> -----------------------------------------
>
>                 Key: CARBONDATA-1484
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1484
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.1.0
>         Environment: spark:1.6.0,mysql hive metastore
>            Reporter: dylan
>             Fix For: NONE
>
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
>   i am use carbondata version is 1.1.0 and spark version is 1.6.0.
>     and I reproduce in accordance with the official quick-start-guide case
> again,
>     1.Creating a Table
> cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name
> String,city String,age int) stored by 'carbondata' ")
>     2.load data into table
>   cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
> table carbondb.test_table")
>     3.start carbonthriftserver
>    /home/zz/spark-1.6.0-bin-hadoop2.6/bin/spark-submit  --master local[*]
> --driver-java-options="-Dcarbon.properties.filepath=/home/zz/spark-1.6.0-bin-hadoop2.6/conf/carbon.properties"
> --executor-memory 4G  --driver-memory 2g  --conf
> spark.serializer=org.apache.spark.serializer.KryoSerializer   --conf
> "spark.sql.shuffle.partitions=3" --conf spark.speculation=true   --class
> org.apache.carbondata.spark.thriftserver.CarbonThriftServer
> /home/zz/spark-1.6.0-bin-hadoop2.6/carbonlib/carbondata_2.10-1.1.0-shade-hadoop2.2.0.jar
> hdfs://nameservice1/user/zz/rp_carbon_store
>    4.Connecting to CarbonData Thrift Server Using Beeline.
>          <http://chuantu.biz/t6/47/1505284993x2890202558.jpg>
>    5.drop table
>    cc.sql("drop table carbondb.test_table")
>    6.recreate table and load data
>     cc.sql("create table IF NOT EXISTS  carbondb.test_table(id string,name
> String,city String,age int) stored by 'carbondata' ")
>     cc.sql("load data inpath 'hdfs://nameservice1/user/zz/sample.csv' into
> table carbondb.test_table")
>    7.select data use beeline
>     <http://chuantu.biz/t6/47/1505284937x1034817476.jpg>
>    Like the above error, the cache is not updated
>  in my case,1,2,5 and 6 step is one session on spark-shell ,4 and 7 is
> one session on beeline,
> and i test this case on the current carbondata master branch(1.2.0),
>  when i use beeline there is no Btree load failed info,but in my table there
> is no data,All the data is null,but in spark-shell is ok.
> spark-shell:
> +---+-----+--------+---+
> | id| name|    city|age|
> +---+-----+--------+---+
> |  1|david|shenzhen| 31|
> |  2|eason|shenzhen| 27|
> |  3|jarry|   wuhan| 35|
> +---+-----+--------+---+
> beeline:
> 0: jdbc:hive2://localhost:10000> select * from  carbondb.test_table;
> +-------+-------+-------+-------+--+
> |  id   | name  | city  |  age  |
> +-------+-------+-------+-------+--+
> | NULL  | NULL  | NULL  | NULL  |
> | NULL  | NULL  | NULL  | NULL  |
> | NULL  | NULL  | NULL  | NULL  |
> +-------+-------+-------+-------+--+



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)