Hi Team,
Getting error after building the carbon data git repo the in Cloudera distribution. in spark-shell console - <console>:25: error: object CarbonContext is not a member of package org.apache.spark.sql import org.apache.spark.sql.CarbonContext Any pointers. Thanks, Srigopal |
Hi Srigopal,
You can follow this: https://github.com/apache/incubator-carbondata/blob/master/docs/quick-start-guide.md Make sure you have correctly configured carbon and spark. Thanks, Lionel On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <[hidden email]> wrote: > Hi Team, > > Getting error after building the carbon data git repo the in Cloudera > distribution. > > in spark-shell console - > > <console>:25: error: object CarbonContext is not a member of package > org.apache.spark.sql > import org.apache.spark.sql.CarbonContext > > > Any pointers. > > Thanks, > Srigopal > |
Hi Lionel,
I followed the same link. I am using cloudera sandbox, which is preconfigured. CarbonData is cloned it from git URL specified. And maven build was done as per the steps mentioned. Thanks, Srigopal On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote: Hi Srigopal, You can follow this: https://github.com/apache/incubator-carbondata/blob/ master/docs/quick-start-guide.md Make sure you have correctly configured carbon and spark. Thanks, Lionel On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <[hidden email]> wrote: > Hi Team, > > Getting error after building the carbon data git repo the in Cloudera > distribution. > > in spark-shell console - > > <console>:25: error: object CarbonContext is not a member of package > org.apache.spark.sql > import org.apache.spark.sql.CarbonContext > > > Any pointers. > > Thanks, > Srigopal > |
What's the spark version you're using?
Did you add "--jars <carbon assembly jar>" when you start the spark shell? On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <[hidden email]> wrote: > Hi Lionel, > > I followed the same link. I am using cloudera sandbox, which is > preconfigured. > > CarbonData is cloned it from git URL specified. And maven build was done > as per the steps mentioned. > > Thanks, > Srigopal > > On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote: > > Hi Srigopal, > You can follow this: > https://github.com/apache/incubator-carbondata/blob/ > master/docs/quick-start-guide.md > Make sure you have correctly configured carbon and spark. > > Thanks, > Lionel > > On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty < > [hidden email]> > wrote: > > > Hi Team, > > > > Getting error after building the carbon data git repo the in Cloudera > > distribution. > > > > in spark-shell console - > > > > <console>:25: error: object CarbonContext is not a member of package > > org.apache.spark.sql > > import org.apache.spark.sql.CarbonContext > > > > > > Any pointers. > > > > Thanks, > > Srigopal > > > |
Spark version is 1.6
Yes i am using spark-shell --jars <assembly jar path> The jars present are - - carbondata-common-1.1.0-incubating-SNAPSHOT.jar - carbondata-core-1.1.0-incubating-SNAPSHOT.jar - carbondata-hadoop-1.1.0-incubating-SNAPSHOT.jar - carbondata-processing-1.1.0-incubating-SNAPSHOT.jar On 07-Apr-2017 1:36 pm, "Lu Cao" <[hidden email]> wrote: What's the spark version you're using? Did you add "--jars <carbon assembly jar>" when you start the spark shell? On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <[hidden email]> wrote: > Hi Lionel, > > I followed the same link. I am using cloudera sandbox, which is > preconfigured. > > CarbonData is cloned it from git URL specified. And maven build was done > as per the steps mentioned. > > Thanks, > Srigopal > > On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote: > > Hi Srigopal, > You can follow this: > https://github.com/apache/incubator-carbondata/blob/ > master/docs/quick-start-guide.md > Make sure you have correctly configured carbon and spark. > > Thanks, > Lionel > > On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty < > [hidden email]> > wrote: > > > Hi Team, > > > > Getting error after building the carbon data git repo the in Cloudera > > distribution. > > > > in spark-shell console - > > > > <console>:25: error: object CarbonContext is not a member of package > > org.apache.spark.sql > > import org.apache.spark.sql.CarbonContext > > > > > > Any pointers. > > > > Thanks, > > Srigopal > > > |
You only need to add the assembly jar, instead of the others you list.
4e.g. assembly/target/scala-2.10/carbondata_2.10-1.1.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar On Fri, Apr 7, 2017 at 4:28 PM, Srigopal Mohanty <[hidden email]> wrote: > Spark version is 1.6 > > Yes i am using spark-shell --jars <assembly jar path> > > The jars present are - > > - carbondata-common-1.1.0-incubating-SNAPSHOT.jar > - carbondata-core-1.1.0-incubating-SNAPSHOT.jar > - carbondata-hadoop-1.1.0-incubating-SNAPSHOT.jar > - carbondata-processing-1.1.0-incubating-SNAPSHOT.jar > > > On 07-Apr-2017 1:36 pm, "Lu Cao" <[hidden email]> wrote: > > What's the spark version you're using? > Did you add "--jars <carbon assembly jar>" when you start the spark shell? > > On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty < > [hidden email]> > wrote: > > > Hi Lionel, > > > > I followed the same link. I am using cloudera sandbox, which is > > preconfigured. > > > > CarbonData is cloned it from git URL specified. And maven build was done > > as per the steps mentioned. > > > > Thanks, > > Srigopal > > > > On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote: > > > > Hi Srigopal, > > You can follow this: > > https://github.com/apache/incubator-carbondata/blob/ > > master/docs/quick-start-guide.md > > Make sure you have correctly configured carbon and spark. > > > > Thanks, > > Lionel > > > > On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty < > > [hidden email]> > > wrote: > > > > > Hi Team, > > > > > > Getting error after building the carbon data git repo the in Cloudera > > > distribution. > > > > > > in spark-shell console - > > > > > > <console>:25: error: object CarbonContext is not a member of package > > > org.apache.spark.sql > > > import org.apache.spark.sql.CarbonContext > > > > > > > > > Any pointers. > > > > > > Thanks, > > > Srigopal > > > > > > |
Free forum by Nabble | Edit this page |