[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: RE: yarn spark job submit problem
From: Chinnappan Chandrasekaran <chiranchandra () jos ! com ! sg>
Date: 2017-01-10 5:36:04
Message-ID: 81d03c86794a4286b7d15f7b9ed6d7fb () jos ! com ! sg
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
Hi
I suspect the code wrong, try the following
file:///home/spark/spark-1.5.1-bin-hadoop2.6/local/spark-b9c155cf-4624-4c6=
8-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip<file:///\\home\s=
park\spark-1.5.1-bin-hadoop2.6\local\spark-b9c155cf-4624-4c68-9d0d-d3b9d57=
48601\__spark_conf__6786864409197988390.zip>
Regards
Chandrasekaran
Technical Consultant
Big Data & Analytics
Business Solution Group
Jardine OneSolution (2001) Pte Ltd
Mobile: (+65) 8138 4761 | Email: chiranchandra@jos.com.sg
67,Ubi Avenue 1 #02-01, North Wing, Starhub Green, Singapore 408942
[JOS_Email_Signature_Signoff_EN]<http://www.jos.com/>
[Facebook]<https://www.facebook.com/jositsolutions>-[LinkedIn]<http://www.=
linkedin.com/company/jos>-[WeChat]<http://pro9465d9.pic12.websiteonline.cn=
/upload/joswechatnew_1rgi.jpg>
From: Zhong,Zhenyu [mailto:edwardzhong@baidu.com]
Sent: Friday, 28 October, 2016 6:58 AM
To: user@hadoop.apache.org
Subject: yarn spark job submit problem
Hi,
I am using spark-1.5.1 and hadoop-2.6.4. After completing the configuratio=
n, I am able to run spark job via YARN.
However, I have a problem that YARN often could't find the local zip-archi=
ve generated during the preparation stage.
I submitted the job using the client mode. Thus the zip-archive was prepar=
ed on the machine which runs the client process.
According to the following log, the zip-archive was there on the local fil=
esystem, however, yarn couldn't find it and report "File Not Found".
Has anyone have similar problems? Any solution for that?
Thanks in advance.
edward
16/10/27 15:17:46 INFO yarn.Client: Will allocate AM container, with 896 M=
B memory including 384 MB overhead
16/10/27 15:17:46 INFO yarn.Client: Setting up container launch context fo=
r our AM
16/10/27 15:17:46 INFO yarn.Client: Setting up the launch environment for =
our AM container
16/10/27 15:17:46 INFO yarn.Client: Preparing resources for our AM contain=
er
16/10/27 15:17:46 INFO yarn.Client: Source and destination file systems ar=
e the same. Not copying file:/home/spark/spark-1.5.1-bin-hadoop2.6/lib/spa=
rk-assembly-1.5.1-hadoop2.6.0.jar
16/10/27 15:17:46 INFO yarn.Client: Source and destination file systems ar=
e the same. Not copying file:/home/spark/spark-1.5.1-bin-hadoop2.6/python/=
lib/pyspark.zip
16/10/27 15:17:46 INFO yarn.Client: Source and destination file systems ar=
e the same. Not copying file:/home/spark/spark-1.5.1-bin-hadoop2.6/python/=
lib/py4j-0.8.2.1-src.zip
16/10/27 15:17:46 INFO yarn.Client: Source and destination file systems ar=
e the same. Not copying file:/home/spark/spark-1.5.1-bin-hadoop2.6/local/s=
park-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__678686440919798839=
0.zip
16/10/27 15:17:46 INFO spark.SecurityManager: Changing view acls to: spark=
16/10/27 15:17:46 INFO spark.SecurityManager: Changing modify acls to: spa=
rk
16/10/27 15:17:46 INFO spark.SecurityManager: SecurityManager: authenticat=
ion disabled; ui acls disabled; users with view permissions: Set(spark); u=
sers with modify permissions: Set(spark)
16/10/27 15:17:46 INFO yarn.Client: Submitting application 2371 to Resourc=
eManager
16/10/27 15:17:46 INFO impl.YarnClientImpl: Submitted application applicat=
ion_1474479656852_2371
16/10/27 15:17:47 INFO yarn.Client: Application report for application_147=
4479656852_2371 (state: ACCEPTED)
16/10/27 15:17:47 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1477606690545
final status: UNDEFINED
tracking URL: http://xlab-node4.usdc.baidu.com:8088/proxy/application_1474=
479656852_2371/
user: spark
16/10/27 15:17:48 INFO yarn.Client: Application report for application_147=
4479656852_2371 (state: ACCEPTED)
16/10/27 15:17:49 INFO yarn.Client: Application report for application_147=
4479656852_2371 (state: FAILED)
16/10/27 15:17:49 INFO yarn.Client:
client token: N/A
diagnostics: Application application_1474479656852_2371 failed 2 times due=
to AM Container for appattempt_1474479656852_2371_000002 exited with exi=
tCode: -1000
For more detailed output, check application tracking page:http://xlab-node=
4.usdc.baidu.com:8088/proxy/application_1474479656852_2371/Then, click on =
links to logs of each attempt.
Diagnostics: File file:/home/spark/spark-1.5.1-bin-hadoop2.6/local/spark-b=
9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip =
does not exist
java.io.FileNotFoundException: File file:/home/spark/spark-1.5.1-bin-hadoo=
p2.6/local/spark-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__678686=
4409197988390.zip does not exist
______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________
______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
Confidentiality Notice and Disclaimer: This email (including any attachmen=
t to it) is confidential and intended only for the use of the individual o=
r entity named above and may contain information that is privileged. If y=
ou are not the intended recipient, you are notified that any dissemination=
, distribution or copying of this email is strictly prohibited. If you ha=
ve received this email in error, please notify us immediately by return em=
ail or telephone and destroy the original message (including any attachmen=
t to it). Thank you.
______________________________________________________________________
[Attachment #5 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe Script";
panose-1:2 11 5 4 2 0 0 0 0 3;}
@font-face
{font-family:"Andale Mono";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.apple-tab-span
{mso-style-name:apple-tab-span;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-SG" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Hi
<o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">I \
suspect the code wrong, try the following <o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Andale \
Mono",serif;color:red"><a \
href="file:///\\home\spark\spark-1.5.1-bin-hadoop2.6\local\spark-b9c155cf-4624-4c68-9d \
0d-d3b9d5748601\__spark_conf__6786864409197988390.zip">file:///home/spark/spark-1.5.1- \
bin-hadoop2.6/local/spark-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip</a><o:p></o:p></span></b></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="EN-US" \
style="font-family:"Segoe \
Script",sans-serif;color:black">Chandrasekaran<o:p></o:p></span></b></p> <p \
class="MsoNormal" style="text-autospace:none"><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">Technical \
Consultant<o:p></o:p></span></p> <p class="MsoNormal" \
style="text-autospace:none"><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">Big \
Data & Analytics <o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">Business \
Solution Group<o:p></o:p></span></p> <p class="MsoNormal" \
style="text-autospace:none"><span lang="EN-US" \
style="font-size:8.0pt;font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><b><span lang="EN-US" \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#C00000">Jardine \
OneSolution (2001) Pte Ltd<o:p></o:p></span></b></p> <p class="MsoNormal" \
style="text-autospace:none"><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:#7F7F7F">Mobile: \
(+65) 8138 4761 | Email: chiranchandra@jos.com.sg<o:p></o:p></span></p> <p \
class="MsoNormal" style="text-autospace:none"><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:#7F7F7F">67,Ubi
</span><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:gray">Avenue \
1 #02-01, North Wing, Starhub Green, Singapore 408942<o:p></o:p></span></p> <p \
class="MsoNormal" style="text-autospace:none"><span lang="EN-US" \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:gray"><o:p> </o:p></span></p>
<p class="MsoNormal"><a href="http://www.jos.com/"><span \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#1F497D;text-decoration:none"><img \
border="0" width="172" height="104" id="_x0000_i1028" \
src="cid:image001.png@01D26B46.7547ACC0" \
alt="JOS_Email_Signature_Signoff_EN"></span></a><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" \
style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><a href="https://www.facebook.com/jositsolutions"><span \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:white;text-decoration:none"><img \
border="0" width="25" height="25" id="Picture_x0020_1" \
src="cid:image002.png@01D26B46.7547ACC0" alt="Facebook"></span></a><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:white">-</span><a \
href="http://www.linkedin.com/company/jos"><span \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:white;text-decoration:none"><img \
border="0" width="25" height="25" id="Picture_x0020_2" \
src="cid:image003.png@01D26B46.7547ACC0" alt="LinkedIn"></span></a><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:white">-</span><a \
href="http://pro9465d9.pic12.websiteonline.cn/upload/joswechatnew_1rgi.jpg"><span \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#1F497D;text-decoration:none"><img \
border="0" width="25" height="25" id="Picture_x0020_3" \
src="cid:image004.png@01D26B46.7547ACC0" alt="WeChat"></span></a><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#1F497D"><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" \
style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span \
lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> \
Zhong,Zhenyu [mailto:edwardzhong@baidu.com] <br>
<b>Sent:</b> Friday, 28 October, 2016 6:58 AM<br>
<b>To:</b> user@hadoop.apache.org<br>
<b>Subject:</b> yarn spark job submit problem<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">Hi,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">I am \
using spark-1.5.1 and hadoop-2.6.4. After completing the configuration, I am able to \
run spark job via YARN.<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">However, \
I have a problem that YARN often could’t find the local zip-archive generated \
during the preparation stage. <o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">I \
submitted the job using the client mode. Thus the zip-archive was prepared on the \
machine which runs the client process.<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">According \
to the following log, the zip-archive was there on the local filesystem, however, \
yarn couldn’t find it and report “File Not \
Found”.<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black">Has \
anyone have similar problems? Any solution for that?<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif">Thanks in \
advance.<o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif">edward<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Will allocate AM container, with 896 MB memory including 384 MB \
overhead<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Setting up container launch context for our \
AM<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Setting up the launch environment for our AM \
container<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Preparing resources for our AM container<o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Source and destination file systems are the same. Not copying \
file:/home/spark/spark-1.5.1-bin-hadoop2.6/lib/spark-assembly-1.5.1-hadoop2.6.0.jar<o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Source and destination file systems are the same. Not copying \
file:/home/spark/spark-1.5.1-bin-hadoop2.6/python/lib/pyspark.zip<o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Source and destination file systems are the same. Not copying \
file:/home/spark/spark-1.5.1-bin-hadoop2.6/python/lib/py4j-0.8.2.1-src.zip<o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><b><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif;color:red">16/10/27 \
15:17:46 INFO yarn.Client: Source and destination file systems are the same. Not \
copying file:/home/spark/spark-1.5.1-bin-hadoop2.6/local/spark-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip</span></b><span \
style="font-size:9.0pt;font-family:"Andale \
Mono",serif"><o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO spark.SecurityManager: Changing view acls to: spark<o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO spark.SecurityManager: Changing modify acls to: spark<o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls \
disabled; users with view permissions: Set(spark); users with modify permissions: \
Set(spark)<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO yarn.Client: Submitting application 2371 to \
ResourceManager<o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:46 \
INFO impl.YarnClientImpl: Submitted application \
application_1474479656852_2371<o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:47 \
INFO yarn.Client: Application report for application_1474479656852_2371 (state: \
ACCEPTED)<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:47 \
INFO yarn.Client: <o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">client token: \
N/A<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">diagnostics: \
N/A<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">ApplicationMaster \
host: N/A<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">ApplicationMaster \
RPC port: -1<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">queue: \
default<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">start time: \
1477606690545<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">final status: \
UNDEFINED<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">tracking URL: <a \
href="http://xlab-node4.usdc.baidu.com:8088/proxy/application_1474479656852_2371/"> \
http://xlab-node4.usdc.baidu.com:8088/proxy/application_1474479656852_2371/</a><o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">user: \
spark<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:48 \
INFO yarn.Client: Application report for application_1474479656852_2371 (state: \
ACCEPTED)<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:49 \
INFO yarn.Client: Application report for application_1474479656852_2371 (state: \
FAILED)<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">16/10/27 15:17:49 \
INFO yarn.Client: <o:p></o:p></span></p> <p \
style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">client token: \
N/A<o:p></o:p></span></p> <p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">diagnostics: \
Application application_1474479656852_2371 failed 2 times due to AM Container for \
appattempt_1474479656852_2371_000002 exited with exitCode:
-1000<o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">For more detailed \
output, check application tracking \
page:http://xlab-node4.usdc.baidu.com:8088/proxy/application_1474479656852_2371/Then, \
click on links to logs of each attempt.<o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><span \
style="font-size:9.0pt;font-family:"Andale Mono",serif">Diagnostics: File \
file:/home/spark/spark-1.5.1-bin-hadoop2.6/local/spark-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip \
does not exist<o:p></o:p></span></p>
<p style="margin:0cm;margin-bottom:.0001pt"><b><span \
style="font-size:9.0pt;font-family:"Andale \
Mono",serif;color:red">java.io.FileNotFoundException: File \
file:/home/spark/spark-1.5.1-bin-hadoop2.6/local/spark-b9c155cf-4624-4c68-9d0d-d3b9d5748601/__spark_conf__6786864409197988390.zip
does not exist</span></b><span style="font-size:9.0pt;font-family:"Andale \
Mono",serif"><o:p></o:p></span></p> </div>
<div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif;color:black"><br> \
<br> <o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span \
style="font-size:10.5pt;font-family:"Calibri",sans-serif"><br> \
______________________________________________________________________<br> This email \
has been scanned by the Symantec Email Security.cloud service.<br> For more \
information please visit <a \
href="http://www.symanteccloud.com">http://www.symanteccloud.com</a><br> \
______________________________________________________________________<o:p></o:p></span></p>
</div>
<br clear="both">
______________________________________________________________________<BR>
This email has been scanned by the Symantec Email Security.cloud service.<BR>
Confidentiality Notice and Disclaimer: This email (including any attachment to it) is \
confidential and intended only for the use of the individual or entity named above \
and may contain information that is privileged. If you are not the intended \
recipient, you are notified that any dissemination, distribution or copying of this \
email is strictly prohibited. If you have received this email in error, please \
notify us immediately by return email or telephone and destroy the original message \
(including any attachment to it). Thank you.<BR> \
______________________________________________________________________<BR> </body>
</html>
["image001.png" (image/png)]
["image002.png" (image/png)]
["image003.png" (image/png)]
["image004.png" (image/png)]
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic