[jira] [Updated] (CARBONDATA-590) unusual behaviour of using carbonthrift server with spark 2.0

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-590) unusual behaviour of using carbonthrift server with spark 2.0

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

anubhav tarar updated CARBONDATA-590:
-------------------------------------
    Description:
have a look at these logs

started thrift server

./bin/spark-submit --conf spark.sql.hive.thriftServer.singleSession=true --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer $SPARK_HOME/carbonlib/carbondata_2.11-1.0.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar hdfs://localhost:54310/opt/carbonStore

logs

INFO  04-01 12:46:55,421 - Service:ThriftBinaryCLIService is started.
INFO  04-01 12:46:55,421 - Service:HiveServer2 is started.


started beeline
connected to thrift server

 !connect jdbc:hive2://localhost:10000

executed the query

CREATE TABLE Bug212(int string)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t100");

Error:
org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Table
default.t 100 can not be created without key columns. Please use
DICTIONARY_INCLUDE or DICTIONARY_EXCLUDE to set at least one key column if
all specified columns are numeric types (state=,code=0)

2 minutes later

 CREATE TABLE Bug211(int int)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t 100");

+---------+--+
| Result  |
+---------+--+
+---------+--+
No rows selected (0.212 seconds)




  was:
have a look at these logs

CREATE TABLE Bug212(int string)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t100");

Error:
org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Table
default.t 100 can not be created without key columns. Please use
DICTIONARY_INCLUDE or DICTIONARY_EXCLUDE to set at least one key column if
all specified columns are numeric types (state=,code=0)

2 minutes later

 CREATE TABLE Bug211(int int)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t 100");

CREATE TABLE Bug211(int int)USING org.apache.spark.sql.CarbonSource
OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t 100");




> unusual behaviour of using carbonthrift server with spark 2.0
> -------------------------------------------------------------
>
>                 Key: CARBONDATA-590
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-590
>             Project: CarbonData
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.0.0-incubating
>            Reporter: anubhav tarar
>
> have a look at these logs
> started thrift server
> ./bin/spark-submit --conf spark.sql.hive.thriftServer.singleSession=true --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer $SPARK_HOME/carbonlib/carbondata_2.11-1.0.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar hdfs://localhost:54310/opt/carbonStore
> logs
> INFO  04-01 12:46:55,421 - Service:ThriftBinaryCLIService is started.
> INFO  04-01 12:46:55,421 - Service:HiveServer2 is started.
> started beeline
> connected to thrift server
>  !connect jdbc:hive2://localhost:10000
> executed the query
> CREATE TABLE Bug212(int string)USING org.apache.spark.sql.CarbonSource
> OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t100");
> Error:
> org.apache.carbondata.spark.exception.MalformedCarbonCommandException: Table
> default.t 100 can not be created without key columns. Please use
> DICTIONARY_INCLUDE or DICTIONARY_EXCLUDE to set at least one key column if
> all specified columns are numeric types (state=,code=0)
> 2 minutes later
>  CREATE TABLE Bug211(int int)USING org.apache.spark.sql.CarbonSource
> OPTIONS("bucketnumber"="1", "bucketcolumns"="String","tableName"="t 100");
> +---------+--+
> | Result  |
> +---------+--+
> +---------+--+
> No rows selected (0.212 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)