Hi, all
I am new to CarbonData when following the Quick Start Guide <http://carbondata.apache.org/quick-start-guide.html>, following error occured import org.apache.spark.sql.SparkSession import org.apache.spark.sql.CarbonSession._ val carbon = SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession() java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found. at org.apache.spark.sql.SparkSession$Builder.enableHiveSupport(SparkSession.scala:815) at org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession(CarbonSession.scala:80) at org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession(CarbonSession.scala:67) ... 50 elided By the way, I am confused by the "default metastore location, which is pointed to ../carbon.metastore" Is it a configuration file I should write it myself, or a file that will be generated in the specified path? Can any one help me? Thanks & Best Regards Tenghuan |
Hello,
You should use the spark which is build with hive support to use carbondata, so please make sure that Spark is build with hive support. And regarding default metastore location , it is derby db will be created on this location after creating the Carbon session. If you want to change the path of it you can pass it while creating the CarbonSession. Regards, Ravindra. On 10 May 2017 at 20:09, Tenghuan He <[hidden email]> wrote: > Hi, all > > I am new to CarbonData when following the Quick Start Guide > <http://carbondata.apache.org/quick-start-guide.html>, following error > occured > > import org.apache.spark.sql.SparkSession > import org.apache.spark.sql.CarbonSession._ > val carbon = > SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession() > > java.lang.IllegalArgumentException: Unable to instantiate SparkSession > with > Hive support because Hive classes are not found. > at > org.apache.spark.sql.SparkSession$Builder.enableHiveSupport( > SparkSession.scala:815) > at > org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession( > CarbonSession.scala:80) > at > org.apache.spark.sql.CarbonSession$CarbonBuilder.getOrCreateCarbonSession( > CarbonSession.scala:67) > ... 50 elided > > By the way, I am confused by the "default metastore location, which is > pointed to ../carbon.metastore" > Is it a configuration file I should write it myself, or a file that will be > generated in the specified path? > > Can any one help me? > > Thanks & Best Regards > > Tenghuan > -- Thanks & Regards, Ravi |
Hi Ravindra
Thanks very much for your help, it solved my problem:) On Wed, May 10, 2017 at 11:25 PM, Ravindra Pesala <[hidden email]> wrote: > Hello, > > You should use the spark which is build with hive support to use > carbondata, so please make sure that Spark is build with hive support. > And regarding default metastore location , it is derby db will be created > on this location after creating the Carbon session. If you want to change > the path of it you can pass it while creating the CarbonSession. > > Regards, > Ravindra. > > On 10 May 2017 at 20:09, Tenghuan He <[hidden email]> wrote: > > > Hi, all > > > > I am new to CarbonData when following the Quick Start Guide > > <http://carbondata.apache.org/quick-start-guide.html>, following error > > occured > > > > import org.apache.spark.sql.SparkSession > > import org.apache.spark.sql.CarbonSession._ > > val carbon = > > SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession() > > > > java.lang.IllegalArgumentException: Unable to instantiate SparkSession > > with > > Hive support because Hive classes are not found. > > at > > org.apache.spark.sql.SparkSession$Builder.enableHiveSupport( > > SparkSession.scala:815) > > at > > org.apache.spark.sql.CarbonSession$CarbonBuilder. > getOrCreateCarbonSession( > > CarbonSession.scala:80) > > at > > org.apache.spark.sql.CarbonSession$CarbonBuilder. > getOrCreateCarbonSession( > > CarbonSession.scala:67) > > ... 50 elided > > > > By the way, I am confused by the "default metastore location, which is > > pointed to ../carbon.metastore" > > Is it a configuration file I should write it myself, or a file that will > be > > generated in the specified path? > > > > Can any one help me? > > > > Thanks & Best Regards > > > > Tenghuan > > > > > > -- > Thanks & Regards, > Ravi > |
Free forum by Nabble | Edit this page |