Login  Register

Re: Re: Failed to APPEND_FILE, hadoop.hdfs.protocol.AlreadyBeingCreatedException

Posted by Liang Chen on Jan 20, 2017; 8:51am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Failed-to-APPEND-FILE-hadoop-hdfs-protocol-AlreadyBeingCreatedException-tp5433p6900.html

Hi

mvn -DskipTests -Pspark-1.5 -Dspark.version=1.5.2 clean package

Please refer to build doc:
https://github.com/apache/incubator-carbondata/tree/master/build

Regards
Liang

2017-01-20 16:00 GMT+08:00 彭 <[hidden email]>:

> I build the jar with hadoop2.6,  like  "mvn package -DskipTests
> -Pspark-1.5.2 -Phadoop-2.6.0 -DskipTests"
> My Spark version is "spark-1.5.2-bin-hadoop2.6"
> However my hadoop environment is hadoop-2.7.2
>
>
>
> At 2017-01-20 15:05:56, "manish gupta" <[hidden email]> wrote:
> >Hi,
> >
> >Which version of hadoop you are using while compiling the carbondata jar?
> >
> >If you are using hadoop-2.2.0, then please go through the below link which
> >says that there is some issue with hadoop-2.2.0 while writing a file in
> >append mode.
> >
> >http://stackoverflow.com/questions/21655634/hadoop2-2-
> 0-append-file-occur-alreadybeingcreatedexception
> >
> >Regards
> >Manish Gupta
> >
> >On Fri, Jan 20, 2017 at 8:10 AM, ffpeng90 <[hidden email]> wrote:
> >
> >> I have met the same problem.
> >> I load data for three times and this exception always throws at the
> third
> >> time.
> >> I use the branch-1.0 version from git.
> >>
> >> Table :
> >> cc.sql(s"create table if not exists flightdb15(ID Int, date string,
> country
> >> string, name string, phonetype string, serialname string, salary Int)
> ROW
> >> FORMAT SERDE 'org.apache.hadoop.hive.serde2.
> MetadataTypedColumnsetSerDe'
> >> STORED BY 'org.apache.carbondata.format'  TBLPROPERTIES
> >> ('table_blocksize'='256 MB')")
> >>
> >> Exception:
> >>
> >> <http://apache-carbondata-mailing-list-archive.1130556.
> >> n5.nabble.com/file/n6843/bug1.png>
> >>
> >>
> >>
> >>
> >>
> >> --
> >> View this message in context: http://apache-carbondata-
> >> mailing-list-archive.1130556.n5.nabble.com/Failed-to-
> >> APPEND-FILE-hadoop-hdfs-protocol-AlreadyBeingCreatedException-
> >> tp5433p6843.html
> >> Sent from the Apache CarbonData Mailing List archive mailing list
> archive
> >> at Nabble.com.
> >>
>



--
Regards
Liang