[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: Run my own application master on a specific node in a YARN cluster
From:       Drake민영근 <drake.min () nexr ! com>
Date:       2015-03-31 1:47:36
Message-ID: CAE422GAL4_OyUnWcmU1vnqdoczV=vhX=aRv_QYMpNvjAGhQW0A () mail ! gmail ! com
[Download RAW message or body]

Hi,

In these circumstances, there is no easy way to do that. Maybe use
workaround. How about using zookeeper for shared storage? The app master
create predefined zookeeper node when starting with current machine's IP
and Clients always look for that zookeeper node for app master's location.

Thanks.


Drake =EB=AF=BC=EC=98=81=EA=B7=BC Ph.D
kt NexR

On Mon, Mar 30, 2015 at 11:04 AM, Dongwon Kim <eastcirclek@postech.ac.kr>
wrote:

> Hello,
>
> First of all, I'm using Hadoop-2.6.0. I want to launch my own app
> master on a specific node in a YARN cluster in order to open a server
> on a predetermined IP address and port. To that end, I wrote a driver
> program in which I created a ResourceRequest object and called
> setResourceName method to set a hostname, and attached it to a
> ApplicationSubmissionContext object by
> callingsetAMContainerResourceRequest method.
>
> I tried several times but couldn't launch the app master on a specific
> node. After searching code, I found that RMAppAttemptImpl invalidates
> what I've set in ResourceRequest as follows:
>
>     // Currently, following fields are all hard code,
>     // TODO: change these fields when we want to support
>     // priority/resource-name/relax-locality specification for AM
> containers
>     // allocation.
>     appAttempt.amReq.setNumContainers(1);
>     appAttempt.amReq.setPriority(AM_CONTAINER_PRIORITY);
>     appAttempt.amReq.setResourceName(ResourceRequest.ANY);
>     appAttempt.amReq.setRelaxLocality(true);
>
> Is there another way to launch a container for an application master
> on a specific node in Hadoop-2.6.0?
>
> Thanks.
>
> Dongwon Kim
>

[Attachment #3 (text/html)]

<div dir="ltr">Hi,<div><br></div><div>In these  circumstances, there is no easy way \
to do that. Maybe use workaround. How about using zookeeper for shared storage? The \
app master create predefined zookeeper node when starting with current machine&#39;s \
IP and Clients always look for that zookeeper node for app master&#39;s \
location.</div><div><br></div><div>Thanks.</div><div><br></div></div><div \
class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div \
dir="ltr"><div><div dir="ltr">Drake 민영근 Ph.D</div><div>kt \
NexR</div></div></div></div></div> <br><div class="gmail_quote">On Mon, Mar 30, 2015 \
at 11:04 AM, Dongwon Kim <span dir="ltr">&lt;<a \
href="mailto:eastcirclek@postech.ac.kr" \
target="_blank">eastcirclek@postech.ac.kr</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">Hello,<br> <br>
First of all, I&#39;m using Hadoop-2.6.0. I want to launch my own app<br>
master on a specific node in a YARN cluster in order to open a server<br>
on a predetermined IP address and port. To that end, I wrote a driver<br>
program in which I created a ResourceRequest object and called<br>
setResourceName method to set a hostname, and attached it to a<br>
ApplicationSubmissionContext object by<br>
callingsetAMContainerResourceRequest method.<br>
<br>
I tried several times but couldn&#39;t launch the app master on a specific<br>
node. After searching code, I found that RMAppAttemptImpl invalidates<br>
what I&#39;ve set in ResourceRequest as follows:<br>
<br>
      // Currently, following fields are all hard code,<br>
      // TODO: change these fields when we want to support<br>
      // priority/resource-name/relax-locality specification for AM<br>
containers<br>
      // allocation.<br>
      appAttempt.amReq.setNumContainers(1);<br>
      appAttempt.amReq.setPriority(AM_CONTAINER_PRIORITY);<br>
      appAttempt.amReq.setResourceName(ResourceRequest.ANY);<br>
      appAttempt.amReq.setRelaxLocality(true);<br>
<br>
Is there another way to launch a container for an application master<br>
on a specific node in Hadoop-2.6.0?<br>
<br>
Thanks.<br>
<span class="HOEnZb"><font color="#888888"><br>
Dongwon Kim<br>
</font></span></blockquote></div><br></div>



[prev in list] [next in list] [prev in thread] [next in thread]