carbon shell is not working with spark 2.0 version
here are the logs java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.util.Utils$.classForName(Utils.scala:225) at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:686) at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185) at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) |
Yes, it is not working because the support is not yet added, right now it
is low priority task as user can directly use spark-shell to create carbonsession and execute the queries. On 4 January 2017 at 12:40, anubhavtarar <[hidden email]> wrote: > carbon shell is not working with spark 2.0 version > here are the logs > > java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:348) > at org.apache.spark.util.Utils$.classForName(Utils.scala:225) > at > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$ > deploy$SparkSubmit$$runMain(SparkSubmit.scala:686) > at > org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185) > at > org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit. > scala:124) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > > > -- > View this message in context: http://apache-carbondata- > mailing-list-archive.1130556.n5.nabble.com/carbon-shell-is- > not-working-with-spark-2-0-version-tp5436.html > Sent from the Apache CarbonData Mailing List archive mailing list archive > at Nabble.com. > -- Thanks & Regards, Ravi |
In reply to this post by anubhavtarar
Hi,
IMHO, user should be free to use the command line tool provided by compute engine like spark, hive, flink and others. As a file format, I think it is not carbon’s focus to provide this shell tool. Regards, Jacky > 在 2017年1月4日,下午3:10,anubhavtarar <[hidden email]> 写道: > > carbon shell is not working with spark 2.0 version > here are the logs > > java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:348) > at org.apache.spark.util.Utils$.classForName(Utils.scala:225) > at > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:686) > at > org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185) > at > org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > > -- > View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/carbon-shell-is-not-working-with-spark-2-0-version-tp5436.html > Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com. > Received: from mail.apache.org (unknown [140.211.11.3]) > by newmx24.qq.com (NewMx) with SMTP id > for <[hidden email]>; Wed, 04 Jan 2017 15:10:30 +0800 > X-QQ-FEAT: oHiIVEz9/LHc93D1t8IBAkIV/NgTTVnqcP3LYuo2GsdwqEGDeIXQPO7MnEriv > ApIQRmdZdeR9cgxuGS8N9Wjv40YJ/X0NNakBwo5tkN8wELJvA5pCxUrP/p/2AfNnaCO6yLG > Gt8SBoa/qWVRZ9Wmeyhas09IntTMVROOa4bFJ1bhzEfFL3DAkBJZPlUjByiHZhdw1cK3YyX > X2XcrY+SuVpiEuBFcSrQ1RjumaSkRn/hJvjHG2tErU3VhB1I9aJFth9nJHnJwfaE0R6kX+E > 9UF1r37rprWmGf > X-QQ-MAILINFO: N5kFcZDRcyD8uYqnZriIg1axpHwQc7WX/YB7IpDEfoPkOV+/pjBF+YcRm > xCyoSsKO+HAmRPt2rRysQkWbQiN1dNHvrorROXOADgHk5JW6kPPTELpsTdMLxDvO2fUNX+Z > PwiUInAgrluE27Sz2JuAzp5e+S8kA10eoQ== > X-QQ-mid: usamxproxy10t1483513831t672w80 > X-QQ-CSender: dev-return-3256-jacky.likun=[hidden email] > X-QQ-ORGSender: dev-return-3256-jacky.likun=[hidden email] > X-KK-mid:usamxproxy10t1483513831t672w80 > Received: (qmail 32983 invoked by uid 500); 4 Jan 2017 07:10:30 -0000 > Mailing-List: contact [hidden email]; run by ezmlm > Precedence: bulk > List-Help: <mailto:[hidden email]> > List-Unsubscribe: <mailto:[hidden email]> > List-Post: <mailto:[hidden email]> > List-Id: <dev.carbondata.incubator.apache.org> > Reply-To: [hidden email] > Delivered-To: mailing list [hidden email] > Received: (qmail 32971 invoked by uid 99); 4 Jan 2017 07:10:29 -0000 > Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) > by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 04 Jan 2017 07:10:29 +0000 > Received: from localhost (localhost [127.0.0.1]) > by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 2836AC023E > for <[hidden email]>; Wed, 4 Jan 2017 07:10:29 +0000 (UTC) > X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org > X-Spam-Flag: NO > X-Spam-Score: 2.285 > X-Spam-Level: ** > X-Spam-Status: No, score=2.285 tagged_above=-999 required=6.31 > tests=[RCVD_IN_DNSWL_NONE=-0.0001, SPF_SOFTFAIL=0.972, URI_HEX=1.313] > autolearn=disabled > Received: from mx1-lw-eu.apache.org ([10.40.0.8]) > by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) > with ESMTP id cWdLlWwyERWI for <[hidden email]>; > Wed, 4 Jan 2017 07:10:27 +0000 (UTC) > Received: from mbob.nabble.com (mbob.nabble.com [162.253.133.15]) > by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 4AEC45F20B > for <[hidden email]>; Wed, 4 Jan 2017 07:10:27 +0000 (UTC) > Received: from static.162.255.23.22.macminivault.com (unknown [162.255.23.22]) > by mbob.nabble.com (Postfix) with ESMTP id F22C7397E72B > for <[hidden email]>; Tue, 3 Jan 2017 22:54:36 -0800 (PST) > Date: Wed, 4 Jan 2017 00:10:21 -0700 (MST) > From: anubhavtarar <[hidden email]> > To: [hidden email] > Message-ID: <[hidden email]> > Subject: carbon shell is not working with spark 2.0 version > MIME-Version: 1.0 > Content-Type: text/plain; charset=us-ascii > Content-Transfer-Encoding: 7bit > > carbon shell is not working with spark 2.0 version > here are the logs > > java.lang.ClassNotFoundException: org.apache.spark.repl.carbon.Main > at java.net.URLClassLoader.findClass(URLClassLoader.java:381) > at java.lang.ClassLoader.loadClass(ClassLoader.java:424) > at java.lang.ClassLoader.loadClass(ClassLoader.java:357) > at java.lang.Class.forName0(Native Method) > at java.lang.Class.forName(Class.java:348) > at org.apache.spark.util.Utils$.classForName(Utils.scala:225) > at > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:686) > at > org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185) > at > org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210) > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > > -- > View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/carbon-shell-is-not-working-with-spark-2-0-version-tp5436.html > Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com. |
Free forum by Nabble | Edit this page |