Carbon data support for spark 2.1.1 or any HDP's Spark version

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Carbon data support for spark 2.1.1 or any HDP's Spark version

satish.sidnakoppa
The carbon supported spark versions and Hortonworks - HDP supported versions
are different.
I am unable to integrate carbondata and HDP .

In brief , how can I build carbondata jar to on spark 2.1.1
Because I am working on HDP 2.6.2 that has spark 2.1.1 as MAJOR version
whereas carbondata default support is 2.1.0

Due to this when I run carbon session creation.I get below error

val cc =
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession(hdfs
path)
            and got error:
            java.lang.NoClassDefFoundError:
org/apache/spark/sql/catalyst/CatalystConf



-----
regards
Satish
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
regards
Satish