Carbon data support for spark 2.1.1 or any HDP's Spark version

Posted by satish.sidnakoppa on Mar 01, 2019; 8:26am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Carbon-data-support-for-spark-2-1-1-or-any-HDP-s-Spark-version-tp75484.html

The carbon supported spark versions and Hortonworks - HDP supported versions
are different.
I am unable to integrate carbondata and HDP .

In brief , how can I build carbondata jar to on spark 2.1.1
Because I am working on HDP 2.6.2 that has spark 2.1.1 as MAJOR version
whereas carbondata default support is 2.1.0

Due to this when I run carbon session creation.I get below error

val cc =
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession(hdfs
path)
            and got error:
            java.lang.NoClassDefFoundError:
org/apache/spark/sql/catalyst/CatalystConf



-----
regards
Satish
--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/