[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    issue about remove yarn jobs history logs
From:       ch huang <justlooks () gmail ! com>
Date:       2014-05-30 2:56:52
Message-ID: CACeqxwSOUbqwSMd3F2kKiZ3K87bzqZORhHNvVkQ3Bvc=3+Z8XQ () mail ! gmail ! com
[Download RAW message or body]

hi,maillist:
              i want remove jobs history logs ,and i configure the
following info in yarn-site.xml,but it seems no use ,why? ( i use CDH4.4
yarn ,i configue on each datanode ,and my job history server on one of my
datanode)

  <property>
    <name>yarn.log-aggregation-enable</name>
    <value>true</value>
  </property>
  <property>
    <description>Where to aggregate logs to.</description>
    <name>yarn.nodemanager.remote-app-log-dir</name>
    <value>/var/log/hadoop-yarn/apps</value>
  </property>
  <property>
    <name>yarn.log-aggregation.retain-seconds</name>
    <value>1209600</value>  <!-- 14 days -->
  </property>

  <property>
    <name>yarn.log-aggregation.retain-check-interval-seconds</name>
    <value>300</value>
  </property>

[Attachment #3 (text/html)]

<div>hi,maillist:</div>
<div>=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0 i want remove jobs history logs ,and i configure the following in=
fo in yarn-site.xml,but it seems no use ,why? ( i use CDH4.4 yarn ,i config=
ue on each datanode ,and my job history server on one of my datanode)</div>

<div>=C2=A0</div>
<div>=C2=A0 &lt;property&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;name&gt;yarn.log-agg=
regation-enable&lt;/name&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;value&gt;true&lt;/va=
lue&gt;<br>=C2=A0 &lt;/property&gt;<br></div>
<div>=C2=A0 &lt;property&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;description&gt;Where=
 to aggregate logs to.&lt;/description&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;name&g=
t;yarn.nodemanager.remote-app-log-dir&lt;/name&gt;<br>=C2=A0=C2=A0=C2=A0 &l=
t;value&gt;/var/log/hadoop-yarn/apps&lt;/value&gt;<br>
=C2=A0 &lt;/property&gt;<br></div>
<div>=C2=A0 &lt;property&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;name&gt;yarn.log-agg=
regation.retain-seconds&lt;/name&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;value&gt;120=
9600&lt;/value&gt;=C2=A0 &lt;!-- 14 days --&gt;<br>=C2=A0 &lt;/property&gt;=
</div>
<div>=C2=A0</div>
<div>=C2=A0 &lt;property&gt;<br>=C2=A0=C2=A0=C2=A0 &lt;name&gt;yarn.log-agg=
regation.retain-check-interval-seconds&lt;/name&gt;<br>=C2=A0=C2=A0=C2=A0 &=
lt;value&gt;300&lt;/value&gt;<br>=C2=A0 &lt;/property&gt;<br></div>


[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic