[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: How to write/run MPI program on Yarn?
From:       Clark Yang (杨卓荦) <yangzhuoluo () gmail ! com>
Date:       2013-06-30 17:37:36
Message-ID: CABHfxz6i_qOEUqrabBa=1fcDNEai0-OoUqS5qNoHYbmUMRNKkQ () mail ! gmail ! com
[Download RAW message or body]

Hi, sam

   Please try it following the README.md on
https://github.com/clarkyzl/mpich2-yarn/.
  The design is simple ,make each nodemanger runs a "smpd" daemon and make
application master run "mpiexec" to submit mpi jobs. The biggest problem
here, I think, is the yarn scheduler do not support gang secheduling
algorithm, and the scheduling is very very slow.

  Any ideas please feel free to share.

Cheers,
Zhuoluo (Clark) Yang


2013/6/30 Pramod N <npramod05@gmail.com>

> Hi Sam,
> This might interest you.
> https://github.com/clarkyzl/mpich2-yarn
>
>
>
> Pramod N <http://atmachinelearner.blogspot.in>
> Bruce Wayne of web
> @machinelearner <https://twitter.com/machinelearner>
>
> --
>
>
> On Sun, Jun 30, 2013 at 6:02 PM, sam liu <samliuhadoop@gmail.com> wrote:
>
>> Hi Experts,
>>
>> Does Hadoop 2.0.5-alpha supports MPI programs?
>>
>> - If yes, is there any example of writing a MPI program on Yarn? How to
>> write the client side code to configure and submit the MPI job?
>> - If no, which Hadoop version will support MPI programming?
>>
>> Thanks!
>>
>
>

[Attachment #3 (text/html)]

<div dir="ltr">Hi, sam<div><br></div><div><div \
style="font-family:arial,sans-serif;font-size:14px">   Please try it following the \
README.md on <a href="https://github.com/clarkyzl/mpich2-yarn/" \
target="_blank">https://github.com/clarkyzl/mpich2-yarn/</a>.</div>


<div><div>  <span style="font-family:arial,sans-serif;font-size:14px">The design is \
simple ,make each nodemanger runs a &quot;smpd&quot; daemon and make application \
master run &quot;mpiexec&quot; to submit mpi jobs. The biggest problem here, I think, \
is the yarn scheduler do not support gang secheduling algorithm, and the scheduling \
is very very slow.</span></div>

</div></div><div><span \
style="font-family:arial,sans-serif;font-size:14px"><br></span></div><div><span \
style="font-family:arial,sans-serif;font-size:14px">  Any ideas please feel free to \
share.</span></div></div><div class="gmail_extra">

<br clear="all"><div><div>Cheers,</div><div>Zhuoluo (Clark) Yang</div></div>
<br><br><div class="gmail_quote">2013/6/30 Pramod N <span dir="ltr">&lt;<a \
href="mailto:npramod05@gmail.com" \
target="_blank">npramod05@gmail.com</a>&gt;</span><br><blockquote class="gmail_quote" \
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">

<div dir="ltr"><div>Hi Sam,<br></div>This might interest you.<br><a \
href="https://github.com/clarkyzl/mpich2-yarn" \
target="_blank">https://github.com/clarkyzl/mpich2-yarn</a><span class="HOEnZb"><font \
color="#888888"><br>

</font></span></div><div class="gmail_extra"><span class="HOEnZb"><font \
color="#888888"><br clear="all"><div><div dir="ltr"> <div><br><br><a \
href="http://atmachinelearner.blogspot.in" target="_blank"><font>Pramod \
N</font></a><br><span style="color:rgb(0,0,102);font-family:comic sans \
ms,sans-serif">Bruce Wayne of web</span><br> </div><a \
href="https://twitter.com/machinelearner" \
target="_blank">@machinelearner</a><br><br>--<br></div></div></font></span><div><div \
class="h5"> <br><br><div class="gmail_quote">On Sun, Jun 30, 2013 at 6:02 PM, sam liu \
<span dir="ltr">&lt;<a href="mailto:samliuhadoop@gmail.com" \
target="_blank">samliuhadoop@gmail.com</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex">


<div dir="ltr"><div><div>Hi Experts,<br><br></div>Does Hadoop 2.0.5-alpha supports \
MPI programs?<br><br></div>- If yes, is there any example of writing a MPI program on \
Yarn? How to write the client side code to configure and submit the MPI job?<br>



<div><div>- If no, which Hadoop version will support MPI programming?<br><br>Thanks! \
<br></div></div></div> </blockquote></div><br></div></div></div>
</blockquote></div><br></div>



[prev in list] [next in list] [prev in thread] [next in thread]