java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

Tenghuan He
Hi, all

    I am new to CarbonData when following the Quick Start Guide
<http://carbondata.apache.org/quick-start-guide.html>, following error
occured

import org.apache.spark.sql.SparkSession
import org.apache.spark.sql.CarbonSession._
val carbon =
SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession()

java.lang.IllegalArgumentException: Unable to instantiate SparkSession with
Hive support because Hive classes are not found.
  at
org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(SparkSession.scala:815)
  at
org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession(CarbonSession.scala:80)
  at
org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession(CarbonSession.scala:67)
  ... 50 elided

By the way, I am confused by the "default metastore location, which is
pointed to ../carbon.metastore"
Is it a configuration file I should write it myself, or a file that will be
generated in the specified path?

Can any one help me?

Thanks & Best Regards

Tenghuan
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

ravipesala
Hello,

You should use the spark which is build with hive support to use
carbondata, so please make sure that Spark is build with hive support.
And regarding default metastore location , it is derby db will be created
on this location after creating the Carbon session. If you want  to change
the path of it you can pass it while creating the CarbonSession.

Regards,
Ravindra.

On 10 May 2017 at 20:09, Tenghuan He <[hidden email]> wrote:

> Hi, all
>
>     I am new to CarbonData when following the Quick Start Guide
> <http://carbondata.apache.org/quick-start-guide.html>, following error
> occured
>
> import org.apache.spark.sql.SparkSession
> import org.apache.spark.sql.CarbonSession._
> val carbon =
> SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession()
>
> java.lang.IllegalArgumentException: Unable to instantiate SparkSession
> with
> Hive support because Hive classes are not found.
>   at
> org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(
> SparkSession.scala:815)
>   at
> org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession(
> CarbonSession.scala:80)
>   at
> org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession(
> CarbonSession.scala:67)
>   ... 50 elided
>
> By the way, I am confused by the "default metastore location, which is
> pointed to ../carbon.metastore"
> Is it a configuration file I should write it myself, or a file that will be
> generated in the specified path?
>
> Can any one help me?
>
> Thanks & Best Regards
>
> Tenghuan
>



--
Thanks & Regards,
Ravi
Reply | Threaded
Open this post in threaded view
|

Re: java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found.

Tenghuan He
Hi Ravindra

Thanks very much for your help, it solved my problem:)

On Wed, May 10, 2017 at 11:25 PM, Ravindra Pesala <[hidden email]>
wrote:

> Hello,
>
> You should use the spark which is build with hive support to use
> carbondata, so please make sure that Spark is build with hive support.
> And regarding default metastore location , it is derby db will be created
> on this location after creating the Carbon session. If you want  to change
> the path of it you can pass it while creating the CarbonSession.
>
> Regards,
> Ravindra.
>
> On 10 May 2017 at 20:09, Tenghuan He <[hidden email]> wrote:
>
> > Hi, all
> >
> >     I am new to CarbonData when following the Quick Start Guide
> > <http://carbondata.apache.org/quick-start-guide.html>, following error
> > occured
> >
> > import org.apache.spark.sql.SparkSession
> > import org.apache.spark.sql.CarbonSession._
> > val carbon =
> > SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession()
> >
> > java.lang.IllegalArgumentException: Unable to instantiate SparkSession
> > with
> > Hive support because Hive classes are not found.
> >   at
> > org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(
> > SparkSession.scala:815)
> >   at
> > org.apache.spark.sql.CarbonSession$CarbonBuilder.
> getOrCreateCarbonSession(
> > CarbonSession.scala:80)
> >   at
> > org.apache.spark.sql.CarbonSession$CarbonBuilder.
> getOrCreateCarbonSession(
> > CarbonSession.scala:67)
> >   ... 50 elided
> >
> > By the way, I am confused by the "default metastore location, which is
> > pointed to ../carbon.metastore"
> > Is it a configuration file I should write it myself, or a file that will
> be
> > generated in the specified path?
> >
> > Can any one help me?
> >
> > Thanks & Best Regards
> >
> > Tenghuan
> >
>
>
>
> --
> Thanks & Regards,
> Ravi
>