Getting Error in Cloudera Distribution

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Getting Error in Cloudera Distribution

Srigopal Mohanty
Hi Team,

  Getting error after building the carbon data git repo the in Cloudera
distribution.

in spark-shell console -

<console>:25: error: object CarbonContext is not a member of package
org.apache.spark.sql
         import org.apache.spark.sql.CarbonContext


Any pointers.

Thanks,
Srigopal
Reply | Threaded
Open this post in threaded view
|

Re: Getting Error in Cloudera Distribution

lionel061201
Hi Srigopal,
You can follow this:
https://github.com/apache/incubator-carbondata/blob/master/docs/quick-start-guide.md
Make sure you have correctly configured carbon and spark.

Thanks,
Lionel

On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <[hidden email]>
wrote:

> Hi Team,
>
>   Getting error after building the carbon data git repo the in Cloudera
> distribution.
>
> in spark-shell console -
>
> <console>:25: error: object CarbonContext is not a member of package
> org.apache.spark.sql
>          import org.apache.spark.sql.CarbonContext
>
>
> Any pointers.
>
> Thanks,
> Srigopal
>
Reply | Threaded
Open this post in threaded view
|

Re: Getting Error in Cloudera Distribution

Srigopal Mohanty
Hi Lionel,

  I followed the same link. I am using cloudera sandbox, which is
preconfigured.

CarbonData is cloned it from git  URL specified. And maven build was done
as per the steps mentioned.

Thanks,
Srigopal

On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote:

Hi Srigopal,
You can follow this:
https://github.com/apache/incubator-carbondata/blob/
master/docs/quick-start-guide.md
Make sure you have correctly configured carbon and spark.

Thanks,
Lionel

On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <[hidden email]>
wrote:

> Hi Team,
>
>   Getting error after building the carbon data git repo the in Cloudera
> distribution.
>
> in spark-shell console -
>
> <console>:25: error: object CarbonContext is not a member of package
> org.apache.spark.sql
>          import org.apache.spark.sql.CarbonContext
>
>
> Any pointers.
>
> Thanks,
> Srigopal
>
Reply | Threaded
Open this post in threaded view
|

Re: Getting Error in Cloudera Distribution

lionel061201
What's the spark version you're using?
Did you add "--jars <carbon assembly jar>" when you start the spark shell?

On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <[hidden email]>
wrote:

> Hi Lionel,
>
>   I followed the same link. I am using cloudera sandbox, which is
> preconfigured.
>
> CarbonData is cloned it from git  URL specified. And maven build was done
> as per the steps mentioned.
>
> Thanks,
> Srigopal
>
> On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote:
>
> Hi Srigopal,
> You can follow this:
> https://github.com/apache/incubator-carbondata/blob/
> master/docs/quick-start-guide.md
> Make sure you have correctly configured carbon and spark.
>
> Thanks,
> Lionel
>
> On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <
> [hidden email]>
> wrote:
>
> > Hi Team,
> >
> >   Getting error after building the carbon data git repo the in Cloudera
> > distribution.
> >
> > in spark-shell console -
> >
> > <console>:25: error: object CarbonContext is not a member of package
> > org.apache.spark.sql
> >          import org.apache.spark.sql.CarbonContext
> >
> >
> > Any pointers.
> >
> > Thanks,
> > Srigopal
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Getting Error in Cloudera Distribution

Srigopal Mohanty
Spark version is 1.6

Yes i am using spark-shell --jars <assembly jar path>

The jars present are -

   - carbondata-common-1.1.0-incubating-SNAPSHOT.jar
   - carbondata-core-1.1.0-incubating-SNAPSHOT.jar
   - carbondata-hadoop-1.1.0-incubating-SNAPSHOT.jar
   - carbondata-processing-1.1.0-incubating-SNAPSHOT.jar


On 07-Apr-2017 1:36 pm, "Lu Cao" <[hidden email]> wrote:

What's the spark version you're using?
Did you add "--jars <carbon assembly jar>" when you start the spark shell?

On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <[hidden email]>
wrote:

> Hi Lionel,
>
>   I followed the same link. I am using cloudera sandbox, which is
> preconfigured.
>
> CarbonData is cloned it from git  URL specified. And maven build was done
> as per the steps mentioned.
>
> Thanks,
> Srigopal
>
> On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote:
>
> Hi Srigopal,
> You can follow this:
> https://github.com/apache/incubator-carbondata/blob/
> master/docs/quick-start-guide.md
> Make sure you have correctly configured carbon and spark.
>
> Thanks,
> Lionel
>
> On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <
> [hidden email]>
> wrote:
>
> > Hi Team,
> >
> >   Getting error after building the carbon data git repo the in Cloudera
> > distribution.
> >
> > in spark-shell console -
> >
> > <console>:25: error: object CarbonContext is not a member of package
> > org.apache.spark.sql
> >          import org.apache.spark.sql.CarbonContext
> >
> >
> > Any pointers.
> >
> > Thanks,
> > Srigopal
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: Getting Error in Cloudera Distribution

lionel061201
You only need to add the assembly jar, instead of the others you list.
4e.g.
assembly/target/scala-2.10/carbondata_2.10-1.1.0-incubating-SNAPSHOT-shade-hadoop2.2.0.jar

On Fri, Apr 7, 2017 at 4:28 PM, Srigopal Mohanty <[hidden email]>
wrote:

> Spark version is 1.6
>
> Yes i am using spark-shell --jars <assembly jar path>
>
> The jars present are -
>
>    - carbondata-common-1.1.0-incubating-SNAPSHOT.jar
>    - carbondata-core-1.1.0-incubating-SNAPSHOT.jar
>    - carbondata-hadoop-1.1.0-incubating-SNAPSHOT.jar
>    - carbondata-processing-1.1.0-incubating-SNAPSHOT.jar
>
>
> On 07-Apr-2017 1:36 pm, "Lu Cao" <[hidden email]> wrote:
>
> What's the spark version you're using?
> Did you add "--jars <carbon assembly jar>" when you start the spark shell?
>
> On Fri, Apr 7, 2017 at 3:38 PM, Srigopal Mohanty <
> [hidden email]>
> wrote:
>
> > Hi Lionel,
> >
> >   I followed the same link. I am using cloudera sandbox, which is
> > preconfigured.
> >
> > CarbonData is cloned it from git  URL specified. And maven build was done
> > as per the steps mentioned.
> >
> > Thanks,
> > Srigopal
> >
> > On 07-Apr-2017 1:05 pm, "Lu Cao" <[hidden email]> wrote:
> >
> > Hi Srigopal,
> > You can follow this:
> > https://github.com/apache/incubator-carbondata/blob/
> > master/docs/quick-start-guide.md
> > Make sure you have correctly configured carbon and spark.
> >
> > Thanks,
> > Lionel
> >
> > On Fri, Apr 7, 2017 at 3:16 PM, Srigopal Mohanty <
> > [hidden email]>
> > wrote:
> >
> > > Hi Team,
> > >
> > >   Getting error after building the carbon data git repo the in Cloudera
> > > distribution.
> > >
> > > in spark-shell console -
> > >
> > > <console>:25: error: object CarbonContext is not a member of package
> > > org.apache.spark.sql
> > >          import org.apache.spark.sql.CarbonContext
> > >
> > >
> > > Any pointers.
> > >
> > > Thanks,
> > > Srigopal
> > >
> >
>