[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: AW: WebUI's Server don't work and JobHistoryServer missing
From: Mike Wenzel <mwenzel () proheris ! de>
Date: 2016-07-22 11:52:33
Message-ID: DFACCAB6686FFB4E953F18E4EAB3BA4C7B8CF610 () LFM15 ! lfm ! proheris ! de
[Download RAW message or body]
[Attachment #2 (text/plain)]
Hi Sunil,
first of all thanks for helping me out. I found one reason why I had strange \
behaviors which I couldn't reproduce. I'm running two network interfaces on each \
node, and my /etc/hosts only configured all my nodes for a single network interface. \
Interfaces are in different networks and therefore no HTTP-Access for me. After \
cleaning this mess up, my problems seem to be sortable in a clean order.
I know the yarn.resourcemanager.webapp.address property. Due to my network \
misconfiguration a bunch of properties didn't worked as expected.
You were right regarding JobHistoryServer / Proxyserver / Timelineserver. I read this \
guide so often, that I obviously overlooked important parts. After starting my \
JobHistory Server I had a bunch of new ways to track things on WebUIs. Proxy- and \
Timelineserver are two completely new words for me. I going to research both servers.
I'm going to clean and sort my problems for the first now. After doing this, I \
believe that I'll be able to ask specifically for help on a single problem. Regards, \
Mike.
Von: Sunil Govind [mailto:sunil.govind@gmail.com]
Gesendet: Donnerstag, 21. Juli 2016 15:05
An: Mike Wenzel <mwenzel@proheris.de>; user@hadoop.apache.org
Betreff: Re: WebUI's Server don't work and JobHistoryServer missing
Hi Mike
yarn.resourcemanager.webapp.address is to configure Resource Manager Web UI and you \
can access ResourceManager Web UI as "http://<host:port><http://%3chost:port%3e>". It \
will run on 8088 as default if you are not configuring this property explicitly. \
Please refer [https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-common/yarn-default.xml] \
for more detailed information.
I think you are not running JobHistoryServer. pls refer \
[http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html] \
"Hadoop Startup" section. You can run history server by "[mapred]$ \
$HADOOP_PREFIX/sbin/mr-jobhistory-daemon.sh --config $HADOOP_CONF_DIR start \
historyserver" command. If you are interested, you can also run "timelineserver" \
which is for yarn.
Also you might need to run WebAppProxy server to see the MapReduce job application \
master ui. Please refer to above link for cluster setup and it has detailed \
information to start various services.
Thanks
Sunil
On Tue, Jul 19, 2016 at 1:59 PM Mike Wenzel \
<mwenzel@proheris.de<mailto:mwenzel@proheris.de>> wrote: My cluster looks like:
Node1 - NameNode + ResourceManager
Node2 - SecondaryNameNode
Node3 - DataNode (+NodeManager)
Node4 - DataNode (+NodeManager)
Node5 - DataNode (+NodeManager)
http://node1:8088/cluster works.
My problems:
> SecondaryNamenode WebUI: http://node2:50090 doesn't work (ERR_EMPTY_RESPONSE).
> Datanode WebUI: http://node3:50075 looks like there is something wrong: \
> https://i.imgur.com/dbTxtkS.png Also I'm missing the JobHistory Server. Isn't the \
> jobhistory server included in yarn? I tried accessing some URLs I found on the web \
> declared as "default configuration" and always (ERR_EMPTY_RESPONSE). When I run a \
> mapreduce job the output still says: "uri to track the job is \
> httpd://localhost:8080" and when I try to access any node on this port I get no \
> data (ERR_EMPTY_RESPONSE).
Unfortunately I couldn't get this problem solved. I only found a few guides setting \
yarn up. I tried them all and my situation only got worse when adding more properties \
on yarn-site.xml. E.g. the cluster overview-WebUI http://node1:8088/cluster didn't \
worked anymore when adding "yarn.resourcemanager.webapp.address" to yarn-site.xml. \
Can anyone help me out configuring yarn correctly please?
My configuration:
core-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>file:///hdfs/tmp</value<file:///\\hdfs\tmp%3c\value>>
</property>
<property>
<name>fs.defaultFS</name>
<value>hdfs://node1:54310</value>
</property>
</configuration>
hdfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<!-- NameNode configuration -->
<property>
<name>dfs.namenode.name.dir</name>
<value>file:///hdfs/name</value<file:///\\hdfs\name%3c\value>>
</property>
<property>
<name>dfs.namenode.http-address</name>
<value>node1:50070</value>
</property>
<property>
<name>dfs.namenode.checkpoint.dir</name>
<value>file:///hdfs/checkpoint</value<file:///\\hdfs\checkpoint%3c\value>>
</property>
<!-- SecondaryNameNode configuration -->
<property>
<name>dfs.namenode.secondary.http-address</name>
<value>node2:50090</value>
</property>
<!-- DataNode configuration -->
<property>
<name>dfs.datanode.data.dir</name>
<value>file:///hdfs/data</value<file:///\\hdfs\data%3c\value>>
</property>
</configuration>
yarn-site.xml
<?xml version="1.0"?>
<configuration>
<!-- Site specific YARN configuration properties -->
<!-- RessourceManager configuration -->
<property>
<name>yarn.resourcemanager.hostname</name>
<value>node1</value>
</property>
<property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>node1:8031</value>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>node1:8030</value>
</property>
<property>
<name>yarn.resourcemanager.address</name>
<value>node1:8032</value>
</property>
</configuration>
masters
node2
slaves
node3
node4
node5
[Attachment #3 (text/html)]
<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.E-MailFormatvorlage17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:black;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier \
New";color:black;mso-fareast-language:EN-US">Hi Sunil,<o:p></o:p></span></p> <p \
class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier \
New";color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p> <p \
class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier \
New";color:black;mso-fareast-language:EN-US">first of all thanks for helping me \
out. I found one reason why I had strange behaviors which I couldn't reproduce. I'm \
running two network interfaces on each node, and my /etc/hosts only configured all \
my nodes for a single network interface. Interfaces are in different networks and \
therefore no HTTP-Access for me. After cleaning this mess up, my problems seem to be \
sortable in a clean order.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier \
New";color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p> <p \
class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier \
New";color:black;mso-fareast-language:EN-US">I know the </span><span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New"">yarn.resourcemanager.webapp.address property. Due to my network \
misconfiguration a bunch of properties didn't worked as \
expected.<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier \
New""><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier New"">You were right regarding \
JobHistoryServer / Proxyserver / Timelineserver. I read this guide so often, that I \
obviously overlooked important parts. After starting my JobHistory Server I had a \
bunch of new ways to track things on WebUIs. Proxy- and Timelineserver are two \
completely new words for me. I going to research both servers.<o:p></o:p></span></p> \
<p class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier \
New""><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier New"">I'm going to clean and \
sort my problems for the first now. After doing this, I believe that I'll be able to \
ask specifically for help on a single problem.<o:p></o:p></span></p> <p \
class="MsoNormal"><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier New"">Regards, \
Mike.<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" \
style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif">Von:</span></b><span \
style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Sunil Govind \
[mailto:sunil.govind@gmail.com] <br>
<b>Gesendet:</b> Donnerstag, 21. Juli 2016 15:05<br>
<b>An:</b> Mike Wenzel <mwenzel@proheris.de>; user@hadoop.apache.org<br>
<b>Betreff:</b> Re: WebUI's Server don't work and JobHistoryServer \
missing<o:p></o:p></span></p> <p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Hi Mike<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier \
New"">yarn.resourcemanager.webapp.address</span> is to configure Resource \
Manager Web UI and you can access ResourceManager Web UI as "<a \
href="http://%3chost:port%3e">http://<host:port></a>". It will run on \
8088 as default if you are not configuring this property explicitly. Please refer [<a \
href="https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-common/yarn-defaul \
t.xml">https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-common/yarn-default.xml</a>]
for more detailed information.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I think you are not running JobHistoryServer. pls refer [<a \
href="http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterS \
etup.html">http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/ClusterSetup.html</a>]
"Hadoop Startup" section. You can run history server by \
"[mapred]$ $HADOOP_PREFIX/sbin/mr-jobhistory-daemon.sh --config $HADOOP_CONF_DIR \
start historyserver" command.<o:p></o:p></p> </div>
<div>
<p class="MsoNormal">If you are interested, you can also run \
"timelineserver" which is for yarn.<o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Also you might need to run <span \
style="font-size:9.0pt;font-family:"Verdana",sans-serif">WebAppProxy server \
to see the MapReduce job application master ui. Please refer to above link for \
cluster setup and it has detailed information to start various \
services.</span><o:p></o:p></p> </div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:9.0pt;font-family:"Verdana",sans-serif">Thanks</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span \
style="font-size:9.0pt;font-family:"Verdana",sans-serif">Sunil</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Tue, Jul 19, 2016 at 1:59 PM Mike Wenzel <<a \
href="mailto:mwenzel@proheris.de">mwenzel@proheris.de</a>> wrote:<o:p></o:p></p> \
</div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm \
0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div>
<div>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">My cluster looks like:</span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white">
<span lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black"> </span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">Node1 - NameNode + ResourceManager</span><o:p></o:p></p> \
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">Node2 - SecondaryNameNode</span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white">
<span lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">Node3 - DataNode (+NodeManager)</span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white">
<span style="font-size:10.0pt;font-family:"Courier New";color:black">Node4 \
- DataNode (+NodeManager)</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
style="font-size:10.0pt;font-family:"Courier New";color:black">Node5 - \
DataNode (+NodeManager)</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
style="font-size:10.0pt;font-family:"Courier \
New";color:black"> </span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
style="font-size:10.0pt;font-family:"Courier New";color:black"><a \
href="http://node1:8088/cluster" target="_blank">http://node1:8088/cluster</a> \
works.</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
style="font-size:10.0pt;font-family:"Courier \
New";color:black"> </span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">My problems:</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">> SecondaryNamenode WebUI: </span><span \
style="font-size:10.0pt;font-family:"Courier New";color:black"><a \
href="http://node2:50090" target="_blank"><span \
lang="EN-US">http://node2:50090</span></a> </span><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier New";color:black">doesn't work \
(</span><span lang="EN-US" style="font-size:9.0pt;font-family:"Segoe \
UI",sans-serif;color:dimgray;text-transform:uppercase;background:#F7F7F7">ERR_EMPTY_RESPONSE)</span><span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">.</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">> Datanode WebUI: </span><span \
style="font-size:10.0pt;font-family:"Courier New";color:black"><a \
href="http://node3:50075" target="_blank"><span \
lang="EN-US">http://node3:50075</span></a></span><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier New";color:black"> looks like \
there is something wrong: <a href="https://i.imgur.com/dbTxtkS.png" target="_blank"> \
https://i.imgur.com/dbTxtkS.png</a></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">> Also I'm missing the JobHistory Server. Isn't the \
jobhistory server included in yarn? I tried accessing some URLs I found on the web \
declared as "default configuration" and always (</span><span lang="EN-US" \
style="font-size:9.0pt;font-family:"Segoe \
UI",sans-serif;color:dimgray;text-transform:uppercase;background:#F7F7F7">ERR_EMPTY_RESPONSE).</span><o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">> When I run a mapreduce job the output still says: "uri to \
track the job is httpd://localhost:8080" and when I try to access any node on this \
port I get no data (</span><span lang="EN-US" \
style="font-size:9.0pt;font-family:"Segoe \
UI",sans-serif;color:dimgray;text-transform:uppercase;background:#F7F7F7">ERR_EMPTY_RESPONSE)</span><span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">.</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black"> </span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">Unfortunately I couldn't get this problem solved. I only found \
a few guides setting yarn up. I tried them all and my situation only got worse when \
adding more properties on yarn-site.xml. E.g. the cluster overview-WebUI \
</span><span style="font-size:10.0pt;font-family:"Courier \
New";color:black"><a href="http://node1:8088/cluster" target="_blank"><span \
lang="EN-US">http://node1:8088/cluster</span></a></span><span lang="EN-US" \
style="font-size:10.0pt;font-family:"Courier New";color:black"> didn't \
worked anymore when adding "yarn.resourcemanager.webapp.address" to \
yarn-site.xml.</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">Can anyone help me out configuring yarn correctly \
please?</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black"> </span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;background:white"> <span \
lang="EN-US" style="font-size:10.0pt;font-family:"Courier \
New";color:black">My configuration:</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </span><o:p></o:p></p> <div \
style="border:none;border-bottom:solid windowtext 1.0pt;padding:0cm 0cm 1.0pt 0cm"> \
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">core-site.xml</span><o:p></o:p></p> </div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"><?xml version="1.0" \
encoding="UTF-8"?></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><?xml-stylesheet type="text/xsl" \
href="configuration.xsl"?></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><configuration></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>hadoop.tmp.dir</name></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> <value><a \
href="file:///\\hdfs\tmp%3c\value">file:///hdfs/tmp</value</a>></span><o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>fs.defaultFS</name></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> \
<value>hdfs://node1:54310</value></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"></configuration></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> </span><o:p></o:p></p> <div \
style="border:none;border-bottom:solid windowtext 1.0pt;padding:0cm 0cm 1.0pt 0cm"> \
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">hdfs-site.xml</span><o:p></o:p></p> </div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"><?xml version="1.0" \
encoding="UTF-8"?></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><?xml-stylesheet type="text/xsl" \
href="configuration.xsl"?></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><configuration></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><!-- NameNode configuration --></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>dfs.namenode.name.dir</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <value><a \
href="file:///\\hdfs\name%3c\value">file:///hdfs/name</value</a>></span><o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>dfs.namenode.http-address</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<value>node1:50070</value></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>dfs.namenode.checkpoint.dir</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <value><a \
href="file:///\\hdfs\checkpoint%3c\value">file:///hdfs/checkpoint</value</a>></span><o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"><!-- SecondaryNameNode configuration \
--></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>dfs.namenode.secondary.http-address</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<value>node2:50090</value></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"><!-- DataNode configuration \
--></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>dfs.datanode.data.dir</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <value><a \
href="file:///\\hdfs\data%3c\value">file:///hdfs/data</value</a>></span><o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"></configuration></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> </span><o:p></o:p></p> <div \
style="border:none;border-bottom:solid windowtext 1.0pt;padding:0cm 0cm 1.0pt 0cm"> \
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">yarn-site.xml</span><o:p></o:p></p> </div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"><?xml \
version="1.0"?></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><configuration></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><!-- Site specific YARN configuration properties \
--></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"><!-- RessourceManager configuration \
--></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>yarn.resourcemanager.hostname</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<value>node1</value></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>yarn.resourcemanager.resource-tracker.address</name></span><o:p></o:p></p>
<p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> \
<value>node1:8031</value></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>yarn.resourcemanager.scheduler.address</name></span><o:p></o:p></p> \
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<value>node1:8030</value></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> <property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<name>yarn.resourcemanager.address</name></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> \
<value>node1:8032</value></span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </property></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"></configuration></span><o:p></o:p></p> <p \
class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black"> </span><o:p></o:p></p> <div \
style="border:none;border-bottom:solid windowtext 1.0pt;padding:0cm 0cm 1.0pt 0cm"> \
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">masters</span><o:p></o:p></p> </div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">node2</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black"> </span><o:p></o:p></p> <div \
style="border:none;border-bottom:solid windowtext 1.0pt;padding:0cm 0cm 1.0pt 0cm"> \
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">slaves</span><o:p></o:p></p> </div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span \
lang="EN-US" style="color:black">node3</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black">node4</span><o:p></o:p></p> <p class="MsoNormal" \
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" \
style="color:black">node5</span><o:p></o:p></p> </div>
</div>
</blockquote>
</div>
</div>
</body>
</html>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic