[prev in list] [next in list] [prev in thread] [next in thread]
List: hadoop-user
Subject: Re: How to find Blacklisted Nodes via cli.
From: Dhanasekaran Anbalagan <bugcy013 () gmail ! com>
Date: 2013-01-31 14:48:54
Message-ID: CAJzooYfn3dA5d7r5SB9WVrELNtfqRiPMxhARrV2Oob_JvpB1Fw () mail ! gmail ! com
[Download RAW message or body]
Hi Harsh,
Thanks I understand, In HDFS Dead Nodes concept.
In MapReduce How to clear blacklisted nodes via command line. We are using
CM, we have frequently nodes will be blacklisted It's very hard to select
nodes and restart the mapreduce services via CM.
Please guide me command line option clear the blacklisted nodes restart
the task tracker on particular node
-Dhanasekaran.
Did I learn something today? If not, I wasted it.
On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <harsh@cloudera.com> wrote:
> There isn't a concept of 'blacklist' in HDFS, it exists only in
> MapReduce (MR1) and YARN.
>
> Dead Nodes (and those that have been excluded) are reported via "hdfs
> dfsadmin -report" as indicated earlier.
>
> On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan
> <bugcy013@gmail.com> wrote:
> > Hi Hemanth,
> >
> > Thanks for spending your valuable time for me.
> >
> > This mapred job -list-blacklisted-trackers for find jobtracker level but
> I
> > want hdfs level I didn't find any command. [HDFS Blacklisted nodes]
> Please
> > guide me. And also to clear blacklisted nodes via command line
> >
> > -Dhanasekaran.
> >
> > Did I learn something today? If not, I wasted it.
> >
> >
> > On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala
> > <yhemanth@thoughtworks.com> wrote:
> >>
> >> Hi,
> >>
> >> Part answer: you can get the blacklisted tasktrackers using the command
> >> line:
> >>
> >> mapred job -list-blacklisted-trackers.
> >>
> >> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' if
> it
> >> works fine after some time. Though I am not very sure about this.
> >>
> >> Thanks
> >> hemanth
> >>
> >>
> >> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan
> >> <bugcy013@gmail.com> wrote:
> >>>
> >>> Hi Guys,
> >>>
> >>> How to find Blacklisted Nodes via, command line. I want to see job
> >>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.
> >>>
> >>> and also how to clear blacklisted nodes to clear start. The only option
> >>> to restart the service. some other way clear the Blacklisted Nodes.
> >>>
> >>> please guide me.
> >>>
> >>> -Dhanasekaran.
> >>>
> >>> Did I learn something today? If not, I wasted it.
> >>
> >>
> >
>
>
>
> --
> Harsh J
>
[Attachment #3 (text/html)]
<div dir="ltr">Hi Harsh,<div><br></div><div style>Thanks I understand, In HDFS Dead \
Nodes concept.</div><div style>In MapReduce How to clear blacklisted nodes via \
command line. We are using CM, we have frequently nodes will be blacklisted \
It's very hard to select nodes and restart the mapreduce services via CM.</div>
<div style><br></div><div style>Please guide me command line option clear the \
blacklisted nodes restart the task tracker on particular node</div><div \
style><br></div><div style>-Dhanasekaran.</div></div><div class="gmail_extra">
<br clear="all"><div>Did I learn something today? If not, I wasted it.</div>
<br><br><div class="gmail_quote">On Thu, Jan 31, 2013 at 9:02 AM, Harsh J <span \
dir="ltr"><<a href="mailto:harsh@cloudera.com" \
target="_blank">harsh@cloudera.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">
There isn't a concept of 'blacklist' in HDFS, it exists only in<br>
MapReduce (MR1) and YARN.<br>
<br>
Dead Nodes (and those that have been excluded) are reported via "hdfs<br>
dfsadmin -report" as indicated earlier.<br>
<br>
On Thu, Jan 31, 2013 at 7:28 PM, Dhanasekaran Anbalagan<br>
<div class="HOEnZb"><div class="h5"><<a \
href="mailto:bugcy013@gmail.com">bugcy013@gmail.com</a>> wrote:<br> > Hi \
Hemanth,<br> ><br>
> Thanks for spending your valuable time for me.<br>
><br>
> This mapred job -list-blacklisted-trackers for find jobtracker level but I<br>
> want hdfs level I didn't find any command. [HDFS Blacklisted nodes] \
Please<br> > guide me. And also to clear blacklisted nodes via command line<br>
><br>
> -Dhanasekaran.<br>
><br>
> Did I learn something today? If not, I wasted it.<br>
><br>
><br>
> On Wed, Jan 30, 2013 at 11:25 PM, Hemanth Yamijala<br>
> <<a href="mailto:yhemanth@thoughtworks.com">yhemanth@thoughtworks.com</a>> \
wrote:<br> >><br>
>> Hi,<br>
>><br>
>> Part answer: you can get the blacklisted tasktrackers using the command<br>
>> line:<br>
>><br>
>> mapred job -list-blacklisted-trackers.<br>
>><br>
>> Also, I think that a blacklisted tasktracker becomes 'unblacklisted' \
if it<br> >> works fine after some time. Though I am not very sure about \
this.<br> >><br>
>> Thanks<br>
>> hemanth<br>
>><br>
>><br>
>> On Wed, Jan 30, 2013 at 9:35 PM, Dhanasekaran Anbalagan<br>
>> <<a href="mailto:bugcy013@gmail.com">bugcy013@gmail.com</a>> \
wrote:<br> >>><br>
>>> Hi Guys,<br>
>>><br>
>>> How to find Blacklisted Nodes via, command line. I want to see job<br>
>>> Tracker Blacklisted Nodes and hdfs Blacklisted Nodes.<br>
>>><br>
>>> and also how to clear blacklisted nodes to clear start. The only \
option<br> >>> to restart the service. some other way clear the Blacklisted \
Nodes.<br> >>><br>
>>> please guide me.<br>
>>><br>
>>> -Dhanasekaran.<br>
>>><br>
>>> Did I learn something today? If not, I wasted it.<br>
>><br>
>><br>
><br>
<br>
<br>
<br>
</div></div><span class="HOEnZb"><font color="#888888">--<br>
Harsh J<br>
</font></span></blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic