[jira] [Updated] (CARBONDATA-1919) sbt project with carbondata dependencies got error when compiling

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-1919) sbt project with carbondata dependencies got error when compiling

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

CHENYANG XU updated CARBONDATA-1919:
------------------------------------
    Description:
In my sbt project, I added carbondata-spark2 dependency like below:

libraryDependencies += "org.apache.carbondata" % "carbondata-spark2" % "1.2.0"

Unfortunately error occured during compilation:

{noformat}
[warn] Note: Unresolved dependencies path:
[warn] org.apache.spark:spark-sql_${scala.binary.version}:${spark.version}
[warn]  +- org.apache.carbondata:carbondata-core:1.2.0
[warn]  +- org.apache.carbondata:carbondata-processing:1.2.0
[warn]  +- org.apache.carbondata:carbondata-hadoop:1.2.0
[warn]  +- org.apache.carbondata:carbondata-spark-common:1.2.0
[warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
[warn] org.apache.spark:spark-hive-thriftserver_${scala.binary.version}:${spark.version}
[warn]  +- org.apache.carbondata:carbondata-spark-common:1.2.0
[warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
[warn] org.apache.spark:spark-repl_${scala.binary.version}:${spark.version}
[warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0

[error] sbt.ResolveException: unresolved dependency: org.apache.spark#spark-sql_${scala.binary.version};${spark.version}: not found
[error] unresolved dependency: org.apache.spark#spark-hive-thriftserver_${scala.binary.version};${spark.version}: not found
[error] unresolved dependency: org.apache.spark#spark-repl_${scala.binary.version};${spark.version}: not found
{noformat}

The project has a lot of spark dependencies, and all versions of spark-sql can be found in my .ivy2 folder and .m2 folder. Also when I remove the carbondata dependency, everything works fine. An empty sbt project with only carbondata dependency has the same problem, but maven project can successfully resolve the dependency.


  was:
In my sbt project, I added carbondata-spark2 dependency like below:

libraryDependencies += "org.apache.carbondata" % "carbondata-spark2" % "1.2.0"

Unfortunately error occured during compilation:

{noformat}
[warn] Note: Unresolved dependencies path:
[warn] org.apache.spark:spark-sql_${scala.binary.version}:${spark.version}
[warn]  +- org.apache.carbondata:carbondata-core:1.2.0
[warn]  +- org.apache.carbondata:carbondata-processing:1.2.0
[warn]  +- org.apache.carbondata:carbondata-hadoop:1.2.0
[warn]  +- org.apache.carbondata:carbondata-spark-common:1.2.0
[warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
[warn] org.apache.spark:spark-hive-thriftserver_${scala.binary.version}:${spark.version}
[warn]  +- org.apache.carbondata:carbondata-spark-common:1.2.0
[warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
[warn] org.apache.spark:spark-repl_${scala.binary.version}:${spark.version}
[warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0

[error] sbt.ResolveException: unresolved dependency: org.apache.spark#spark-sql_${scala.binary.version};${spark.version}: not found
[error] unresolved dependency: org.apache.spark#spark-hive-thriftserver_${scala.binary.version};${spark.version}: not found
[error] unresolved dependency: org.apache.spark#spark-repl_${scala.binary.version};${spark.version}: not found
{noformat}

The project has a lot of spark dependencies, and all versions of spark-sql can be found in my .ivy2 folder and .m2 folder. Also when I remove the carbondata dependency, everything works fine. An empty sbt project with only carbondata dependency has the same problem, but maven project can successfully resolve the dependence.



> sbt project with carbondata dependencies got error when compiling
> -----------------------------------------------------------------
>
>                 Key: CARBONDATA-1919
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1919
>             Project: CarbonData
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.2.0
>         Environment: sbt 0.13.15
>            Reporter: CHENYANG XU
>
> In my sbt project, I added carbondata-spark2 dependency like below:
> libraryDependencies += "org.apache.carbondata" % "carbondata-spark2" % "1.2.0"
> Unfortunately error occured during compilation:
> {noformat}
> [warn] Note: Unresolved dependencies path:
> [warn] org.apache.spark:spark-sql_${scala.binary.version}:${spark.version}
> [warn]  +- org.apache.carbondata:carbondata-core:1.2.0
> [warn]  +- org.apache.carbondata:carbondata-processing:1.2.0
> [warn]  +- org.apache.carbondata:carbondata-hadoop:1.2.0
> [warn]  +- org.apache.carbondata:carbondata-spark-common:1.2.0
> [warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
> [warn] org.apache.spark:spark-hive-thriftserver_${scala.binary.version}:${spark.version}
> [warn]  +- org.apache.carbondata:carbondata-spark-common:1.2.0
> [warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
> [warn] org.apache.spark:spark-repl_${scala.binary.version}:${spark.version}
> [warn]  +- org.apache.carbondata:carbondata-spark2:1.2.0
> [error] sbt.ResolveException: unresolved dependency: org.apache.spark#spark-sql_${scala.binary.version};${spark.version}: not found
> [error] unresolved dependency: org.apache.spark#spark-hive-thriftserver_${scala.binary.version};${spark.version}: not found
> [error] unresolved dependency: org.apache.spark#spark-repl_${scala.binary.version};${spark.version}: not found
> {noformat}
> The project has a lot of spark dependencies, and all versions of spark-sql can be found in my .ivy2 folder and .m2 folder. Also when I remove the carbondata dependency, everything works fine. An empty sbt project with only carbondata dependency has the same problem, but maven project can successfully resolve the dependency.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)