carbon shell is not working with spark 2.0 version

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

carbon shell is not working with spark 2.0 version

anubhavtarar
carbon shell is not working with spark 2.0 version
here are the logs

java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:348)
        at org.apache.spark.util.Utils$.classForName(Utils.scala:225)
        at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:686)
        at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
        at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Reply | Threaded
Open this post in threaded view
|

Re: carbon shell is not working with spark 2.0 version

ravipesala
Yes, it is not working because the support is not yet added, right now it
is low priority task as user can directly use spark-shell to create
carbonsession and execute the queries.

On 4 January 2017 at 12:40, anubhavtarar <[hidden email]> wrote:

> carbon shell is not working with spark 2.0 version
> here are the logs
>
> java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         at java.lang.Class.forName0(Native Method)
>         at java.lang.Class.forName(Class.java:348)
>         at org.apache.spark.util.Utils$.classForName(Utils.scala:225)
>         at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$
> deploy$SparkSubmit$$runMain(SparkSubmit.scala:686)
>         at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
>         at
> org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
>         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.
> scala:124)
>         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
>
> --
> View this message in context: http://apache-carbondata-
> mailing-list-archive.1130556.n5.nabble.com/carbon-shell-is-
> not-working-with-spark-2-0-version-tp5436.html
> Sent from the Apache CarbonData Mailing List archive mailing list archive
> at Nabble.com.
>



--
Thanks & Regards,
Ravi
Reply | Threaded
Open this post in threaded view
|

Re: carbon shell is not working with spark 2.0 version

Jacky Li
In reply to this post by anubhavtarar
Hi,

IMHO, user should be free to use the command line tool provided by compute engine like spark, hive, flink and others. As a file format, I think it is not carbon’s focus to provide this shell tool.

Regards,
Jacky

> 在 2017年1月4日,下午3:10,anubhavtarar <[hidden email]> 写道:
>
> carbon shell is not working with spark 2.0 version
> here are the logs
>
> java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>        at java.lang.Class.forName0(Native Method)
>        at java.lang.Class.forName(Class.java:348)
>        at org.apache.spark.util.Utils$.classForName(Utils.scala:225)
>        at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:686)
>        at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
>        at
> org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
>        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
>        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
> --
> View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/carbon-shell-is-not-working-with-spark-2-0-version-tp5436.html
> Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.
> Received: from mail.apache.org (unknown [140.211.11.3])
> by newmx24.qq.com (NewMx) with SMTP id
> for <[hidden email]>; Wed, 04 Jan 2017 15:10:30 +0800
> X-QQ-FEAT: oHiIVEz9/LHc93D1t8IBAkIV/NgTTVnqcP3LYuo2GsdwqEGDeIXQPO7MnEriv
> ApIQRmdZdeR9cgxuGS8N9Wjv40YJ/X0NNakBwo5tkN8wELJvA5pCxUrP/p/2AfNnaCO6yLG
> Gt8SBoa/qWVRZ9Wmeyhas09IntTMVROOa4bFJ1bhzEfFL3DAkBJZPlUjByiHZhdw1cK3YyX
> X2XcrY+SuVpiEuBFcSrQ1RjumaSkRn/hJvjHG2tErU3VhB1I9aJFth9nJHnJwfaE0R6kX+E
> 9UF1r37rprWmGf
> X-QQ-MAILINFO: N5kFcZDRcyD8uYqnZriIg1axpHwQc7WX/YB7IpDEfoPkOV+/pjBF+YcRm
> xCyoSsKO+HAmRPt2rRysQkWbQiN1dNHvrorROXOADgHk5JW6kPPTELpsTdMLxDvO2fUNX+Z
> PwiUInAgrluE27Sz2JuAzp5e+S8kA10eoQ==
> X-QQ-mid: usamxproxy10t1483513831t672w80
> X-QQ-CSender: dev-return-3256-jacky.likun=[hidden email]
> X-QQ-ORGSender: dev-return-3256-jacky.likun=[hidden email]
> X-KK-mid:usamxproxy10t1483513831t672w80
> Received: (qmail 32983 invoked by uid 500); 4 Jan 2017 07:10:30 -0000
> Mailing-List: contact [hidden email]; run by ezmlm
> Precedence: bulk
> List-Help: <mailto:[hidden email]>
> List-Unsubscribe: <mailto:[hidden email]>
> List-Post: <mailto:[hidden email]>
> List-Id: <dev.carbondata.incubator.apache.org>
> Reply-To: [hidden email]
> Delivered-To: mailing list [hidden email]
> Received: (qmail 32971 invoked by uid 99); 4 Jan 2017 07:10:29 -0000
> Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142)
>    by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Jan 2017 07:10:29 +0000
> Received: from localhost (localhost [127.0.0.1])
> by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 2836AC023E
> for <[hidden email]>; Wed,  4 Jan 2017 07:10:29 +0000 (UTC)
> X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org
> X-Spam-Flag: NO
> X-Spam-Score: 2.285
> X-Spam-Level: **
> X-Spam-Status: No, score=2.285 tagged_above=-999 required=6.31
> tests=[RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.972, URI_HEX=1.313]
> autolearn=disabled
> Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024)
> with ESMTP id cWdLlWwyERWI for <[hidden email]>;
> Wed,  4 Jan 2017 07:10:27 +0000 (UTC)
> Received: from mbob.nabble.com (mbob.nabble.com [162.253.133.15])
> by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 4AEC45F20B
> for <[hidden email]>; Wed,  4 Jan 2017 07:10:27 +0000 (UTC)
> Received: from static.162.255.23.22.macminivault.com (unknown [162.255.23.22])
> by mbob.nabble.com (Postfix) with ESMTP id F22C7397E72B
> for <[hidden email]>; Tue,  3 Jan 2017 22:54:36 -0800 (PST)
> Date: Wed, 4 Jan 2017 00:10:21 -0700 (MST)
> From: anubhavtarar <[hidden email]>
> To: [hidden email]
> Message-ID: <[hidden email]>
> Subject: carbon shell is not working with spark 2.0 version
> MIME-Version: 1.0
> Content-Type: text/plain; charset=us-ascii
> Content-Transfer-Encoding: 7bit
>
> carbon shell is not working with spark 2.0 version
> here are the logs
>
> java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>        at java.lang.Class.forName0(Native Method)
>        at java.lang.Class.forName(Class.java:348)
>        at org.apache.spark.util.Utils$.classForName(Utils.scala:225)
>        at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:686)
>        at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185)
>        at
> org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210)
>        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124)
>        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
> --
> View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/carbon-shell-is-not-working-with-spark-2-0-version-tp5436.html
> Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.