xubo245 created CARBONDATA-3154:
-----------------------------------
Summary: Fix spark-2.1 test error
Key: CARBONDATA-3154
URL:
https://issues.apache.org/jira/browse/CARBONDATA-3154 Project: CarbonData
Issue Type: Bug
Affects Versions: 1.5.1
Reporter: xubo245
Assignee: xubo245
Fix For: 1.5.2
Now the CI didn't run Spark2.1 UT, only compile, so when test spark2.1, there are some errors.
for example:
command:
{code:java}
-Pspark-2.1 clean install
{code}
error1:
{code:java}
2018-12-07 21:47:20 INFO HiveMetaStore:746 - 0: get_database: global_temp
2018-12-07 21:47:20 INFO audit:371 - ugi=xubo ip=unknown-ip-addr cmd=get_database: global_temp
2018-12-07 21:47:20 WARN ObjectStore:568 - Failed to get database global_temp, returning NoSuchObjectException
*** RUN ABORTED ***
org.apache.spark.sql.catalyst.parser.ParseException: mismatched input 'location' expecting {<EOF>, '(', '.', 'SELECT', 'FROM', 'AS', 'WITH', 'VALUES', 'TABLE', 'INSERT', 'MAP', 'REDUCE', 'OPTIONS', 'CLUSTERED', 'PARTITIONED'}(line 1, pos 150)
== SQL ==
create table par_table(male boolean, age int, height double, name string, address string,salary long, floatField float, bytefield byte) using parquet location '/Users/xubo/Desktop/xubo/git/carbondata1/integration/spark-datasource/target/warehouse2'
------------------------------------------------------------------------------------------------------------------------------------------------------^^^
at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99)
at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45)
at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53)
at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.createParquetTable(SparkCarbonDataSourceTest.scala:1126)
at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.beforeAll(SparkCarbonDataSourceTest.scala:1359)
at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187)
at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.beforeAll(SparkCarbonDataSourceTest.scala:38)
at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:253)
...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
{code}
there are another 5 errors in org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Locked
