[jira] [Updated] (CARBONDATA-1105) Remove the fixed spark.version in submodule for supporting new spark version.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-1105) Remove the fixed spark.version in submodule for supporting new spark version.

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Liang Chen updated CARBONDATA-1105:
-----------------------------------
    Description: Remove the fixed spark.version in submodule for supporting new spark version.  (was: I think it is related to SPARK-19944
https://github.com/apache/spark/pull/17301
{code}
scala> carbon.sql("create table temp.test_carbon(id int, name string, scale decimal, country string, salary double) STORED BY 'carbondata'")
java.lang.NoClassDefFoundError: org/apache/spark/sql/catalyst/CatalystConf
  at org.apache.spark.sql.hive.CarbonSessionState.analyzer$lzycompute(CarbonSessionState.scala:127)
  at org.apache.spark.sql.hive.CarbonSessionState.analyzer(CarbonSessionState.scala:126)
  at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:69)
  at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:67)
  at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:50)
  at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:63)
  at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:593)
  ... 52 elided
Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.catalyst.CatalystConf
  at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
  at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
  at java.security.AccessController.doPrivileged(Native Method)
  at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
  at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
  at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
  ... 59 more
{code})

> Remove the fixed spark.version in submodule for supporting new spark version.
> -----------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1105
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1105
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.2.0
>         Environment: spark 2.1.1
>            Reporter: cen yuhai
>            Assignee: cen yuhai
>             Fix For: 1.2.0
>
>          Time Spent: 2h
>  Remaining Estimate: 0h
>
> Remove the fixed spark.version in submodule for supporting new spark version.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)