[jira] [Resolved] (CARBONDATA-3154) Fix spark-2.1 test error

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Resolved] (CARBONDATA-3154) Fix spark-2.1 test error

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kunal Kapoor resolved CARBONDATA-3154.
--------------------------------------
    Resolution: Fixed

> Fix spark-2.1 test error
> ------------------------
>
>                 Key: CARBONDATA-3154
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3154
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.5.1
>            Reporter: xubo245
>            Assignee: xubo245
>            Priority: Major
>             Fix For: 1.5.2
>
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Now the CI didn't run Spark2.1 UT, only compile, so when test spark2.1, there are some errors.
> for example:
> command:
> {code:java}
> -Pspark-2.1  clean install
> {code}
> error1:
> {code:java}
> 2018-12-07 21:47:20 INFO  HiveMetaStore:746 - 0: get_database: global_temp
> 2018-12-07 21:47:20 INFO  audit:371 - ugi=xubo ip=unknown-ip-addr cmd=get_database: global_temp
> 2018-12-07 21:47:20 WARN  ObjectStore:568 - Failed to get database global_temp, returning NoSuchObjectException
> *** RUN ABORTED ***
>   org.apache.spark.sql.catalyst.parser.ParseException: mismatched input 'location' expecting {<EOF>, '(', '.', 'SELECT', 'FROM', 'AS', 'WITH', 'VALUES', 'TABLE', 'INSERT', 'MAP', 'REDUCE', 'OPTIONS', 'CLUSTERED', 'PARTITIONED'}(line 1, pos 150)
> == SQL ==
> create table par_table(male boolean, age int, height double, name string, address string,salary long, floatField float, bytefield byte) using parquet location '/Users/xubo/Desktop/xubo/git/carbondata1/integration/spark-datasource/target/warehouse2'
> ------------------------------------------------------------------------------------------------------------------------------------------------------^^^
>   at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197)
>   at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99)
>   at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45)
>   at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53)
>   at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592)
>   at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.createParquetTable(SparkCarbonDataSourceTest.scala:1126)
>   at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.beforeAll(SparkCarbonDataSourceTest.scala:1359)
>   at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187)
>   at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.beforeAll(SparkCarbonDataSourceTest.scala:38)
>   at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:253)
>   ...
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> {code}
> there are another 5 errors in org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)