Posted by
李寅威 on
Dec 19, 2016; 7:34am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/How-to-compile-the-latest-source-code-of-carbondata-tp4633p4642.html
the privileges of the folder "carbondata" is:
drwxr-xr-x 18 hadoop hadoop 4096 Dec 19 14:56 carbondata
and hadoop is the user who run maven.
well, after run mvn command, I get the info from console as follows:
[INFO] Reactor Summary:
[INFO]
[INFO] Apache CarbonData :: Parent ........................ SUCCESS [ 1.012 s]
[INFO] Apache CarbonData :: Common ........................ SUCCESS [ 2.066 s]
[INFO] Apache CarbonData :: Core .......................... SUCCESS [ 5.512 s]
[INFO] Apache CarbonData :: Processing .................... SUCCESS [ 1.892 s]
[INFO] Apache CarbonData :: Hadoop ........................ SUCCESS [ 0.789 s]
[INFO] Apache CarbonData :: Spark Common .................. SUCCESS [ 17.121 s]
[INFO] Apache CarbonData :: Spark ......................... SUCCESS [ 33.269 s]
[INFO] Apache CarbonData :: Assembly ...................... SUCCESS [ 17.700 s]
[INFO] Apache CarbonData :: Spark Examples ................ SUCCESS [ 7.741 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:27 min
[INFO] Finished at: 2016-12-19T14:57:26+08:00
[INFO] Final Memory: 83M/1623M
[INFO] ------------------------------------------------------------------------
but I didn't find a file names spark-submit under the path carbondata/bin/:
[hadoop@master ~]$ cd carbondata/bin/
[hadoop@master bin]$ ll
total 8
-rwxrwxr-x 1 hadoop hadoop 3879 Dec 19 14:54 carbon-spark-shell
-rwxrwxr-x 1 hadoop hadoop 2820 Dec 19 14:54 carbon-spark-sql
is this phenomenon normal ?
------------------ 原始邮件 ------------------
发件人: "Liang Chen";<
[hidden email]>;
发送时间: 2016年12月19日(星期一) 下午3:19
收件人: "dev"<
[hidden email]>;
主题: Re: How to compile the latest source code of carbondata
Hi
Please check if you have added the enough right for folder "carbondata"?
---------------------------------------------------------------------------
For spark 1.5, the compile process has no issue, but carbon-spark-shell
can not run correctly:
step 1: git clone
https://github.com/apache/incubator-carbondata.git carbondata
step 2: mvn clean package -DskipTests -Pspark-1.5
step 3: ./bin/carbon-spark-shell, and it turns out:
[hadoop@master carbondata]$ ./bin/carbon-spark-shell
./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
directory
2016-12-19 15:05 GMT+08:00 251469031 <
[hidden email]>:
> thx liang.
>
>
> I've tried spark 2.0.0 and spark 1.5.0, my step & script is:
>
>
> For spark 2.0, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
>
>
> step 1: git clone
https://github.com/apache/incubator-carbondata.git> carbondata
> step 2: mvn clean package -DskipTests -Pspark-2.0
> step 3: ./bin/carbon-spark-shell, and is turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> such file or directory
> ls: cannot access /home/hadoop/carbondata/assembly/target/scala-2.10: No
> such file or directory
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
>
>
> For spark 1.5, the compile process has no issue, but carbon-spark-shell
> can not run correctly:
> step 1: git clone
https://github.com/apache/incubator-carbondata.git> carbondata
> step 2: mvn clean package -DskipTests -Pspark-1.5
> step 3: ./bin/carbon-spark-shell, and it turns out:
>
>
> [hadoop@master carbondata]$ ./bin/carbon-spark-shell
> ./bin/carbon-spark-shell: line 78: /bin/spark-submit: No such file or
> directory
>
>
>
>
>
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Liang Chen";<
[hidden email]>;
> 发送时间: 2016年12月19日(星期一) 下午2:37
> 收件人: "dev"<
[hidden email]>;
>
> 主题: Re: How to compile the latest source code of carbondata
>
>
>
> Hi
>
> Can you share : do you get what errors and using which compile command?
>
> Regards
> Liang
>
> 2016-12-19 14:32 GMT+08:00 251469031 <
[hidden email]>:
>
> > Hi all:
> >
> > I've tried to comple the latest source code followed by the toturial:
> >
https://cwiki.apache.org/confluence/display/CARBONDATA/Quick+Start , but
> > it doesn't work on the latest source code on the github.
> >
> >
> > Would you send me some toturial about how to do this or tell me how
> to
> > use carbondata, thx~
>
>
>
>
> --
> Regards
> Liang
--
Regards
Liang