[prev in list] [next in list] [prev in thread] [next in thread] 

List:       mesos-user
Subject:    Re: Multiple active masters
From:       Klaus Ma <klaus1982.cn () gmail ! com>
Date:       2015-11-30 13:26:24
Message-ID: CAGmKMfWJsH=jg2L3_NgLHoxGGXBNtd37fdF-My7V=Lm3Mx+EvA () mail ! gmail ! com
[Download RAW message or body]

If the running two agent in slave host, the two clusters will share
resource all the time. One option I can image is to use meta framework to
connect to the two cluster, and balance the resources between the two
cluster.

----
Da (Klaus), Ma (=E9=A9=AC=E8=BE=BE) | PMP=C2=AE | Advisory Software Enginee=
r
Platform Symphony/DCOS Development & Support, STG, IBM GCG
+86-10-8245 4084 | klaus1982.cn@gmail.com | http://k82.me

On Mon, Nov 30, 2015 at 8:01 PM, tommy xiao <xiaods@gmail.com> wrote:

> run two slave in same node is bad idea on production env. i only say, why
> not install two cluster in same DC?
>
> 2015-11-30 14:20 GMT+08:00 Chengwei Yang <chengwei.yang.cn@gmail.com>:
>
>> On Fri, Nov 27, 2015 at 04:16:44PM +0100, Elouan Keryell-Even wrote:
>> > Hi,
>> >
>> > I don't think this is possible yet, but is it planned some day to be
>> able to
>> > work with multiple active Mesos masters?
>> >
>> > I mean, not just a high-availability configuration with one elected
>> master and
>> > a few others idle masters (in case of failure), but really two masters
>> > exploiting a shared pool of slaves.
>> >
>> >
>> > Our use case:
>> >
>> > We are using Mesos to manage resources of two separated clusters. For
>> now, one
>> > cluster acts as a "commandment center" (since it runs the Mesos
>> master), while
>> > the other only runs mesos slaves.
>> >
>> > We would want to have a perfectly symetric architecture, where each
>> cluster
>> > could borrow a few slaves from the other cluster to run some of his
>> jobs.
>> >
>> > In my mind that implies each slave has to be managed by two mesos
>> masters at
>> > the same time.
>>
>> Try run two mesos-slave on the same node though I couldn't buy-in your
>> use case?
>>
>> Of course, you have to configure different LIBPROCESS_PORT to avoid
>> conflict
>> and any other options you want, I didn't do this so I'm not sure if this
>> works.
>>
>>
>> --
>> Thanks,
>> Chengwei
>>
>> >
>> >
>> > I'm curious to have your opinion on this :)
>> >
>> > Elouan Keryell-Even
>> > Software Engineer @ Atos Integration
>> > Toulouse, France
>> > +33 6 64 61 29 56
>> > SECURITY NOTE: file ~/.netrc must not be accessible by others
>>
>
>
>
> --
> Deshi Xiao
> Twitter: xds2000
> E-mail: xiaods(AT)gmail.com
>

[Attachment #3 (text/html)]

<div dir="ltr">If the running two agent in slave host, the two clusters will share \
resource all the time. One option I can image is to use meta framework to connect to \
the two cluster, and balance the resources between the two cluster.<br></div><div \
class="gmail_extra"><br clear="all"><div><div class="gmail_signature"><div \
dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><font size="2"><span \
style="color:rgb(0,0,0);font-family:Calibri,sans-serif">----</span></font></div><div \
dir="ltr"><font size="2"><span \
style="color:rgb(0,0,0);font-family:Calibri,sans-serif">Da (Klaus), Ma (马达) | PMP \
® | Advisory Software Engineer  </span><br \
style="color:rgb(0,0,0);font-family:Calibri,sans-serif"><span \
style="color:rgb(0,0,0);font-family:Calibri,sans-serif">Platform Symphony/DCOS \
Development &amp; Support, STG, IBM GCG  </span><br \
style="color:rgb(0,0,0);font-family:Calibri,sans-serif"><span \
style="color:rgb(0,0,0);font-family:Calibri,sans-serif">+86-10-8245 4084 | <a \
href="mailto:klaus1982.cn@gmail.com" target="_blank">klaus1982.cn@gmail.com</a>  | <a \
href="http://k82.me" \
target="_blank">http://k82.me</a></span></font></div></div></div></div></div></div></div>
 <br><div class="gmail_quote">On Mon, Nov 30, 2015 at 8:01 PM, tommy xiao <span \
dir="ltr">&lt;<a href="mailto:xiaods@gmail.com" \
target="_blank">xiaods@gmail.com</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">run two slave in same node is bad idea on \
production env. i only say, why not install two cluster in same DC?</div><div \
class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">2015-11-30 \
14:20 GMT+08:00 Chengwei Yang <span dir="ltr">&lt;<a \
href="mailto:chengwei.yang.cn@gmail.com" \
target="_blank">chengwei.yang.cn@gmail.com</a>&gt;</span>:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><span>On Fri, Nov 27, 2015 at 04:16:44PM +0100, Elouan \
Keryell-Even wrote:<br> &gt; Hi,<br>
&gt;<br>
&gt; I don&#39;t think this is possible yet, but is it planned some day to be able \
to<br> &gt; work with multiple active Mesos masters?<br>
&gt;<br>
&gt; I mean, not just a high-availability configuration with one elected master \
and<br> &gt; a few others idle masters (in case of failure), but really two \
masters<br> &gt; exploiting a shared pool of slaves.<br>
&gt;<br>
&gt;<br>
&gt; Our use case:<br>
&gt;<br>
&gt; We are using Mesos to manage resources of two separated clusters. For now, \
one<br> &gt; cluster acts as a &quot;commandment center&quot; (since it runs the \
Mesos master), while<br> &gt; the other only runs mesos slaves.<br>
&gt;<br>
&gt; We would want to have a perfectly symetric architecture, where each cluster<br>
&gt; could borrow a few slaves from the other cluster to run some of his jobs.<br>
&gt;<br>
&gt; In my mind that implies each slave has to be managed by two mesos masters at<br>
&gt; the same time.<br>
<br>
</span>Try run two mesos-slave on the same node though I couldn&#39;t buy-in your use \
case?<br> <br>
Of course, you have to configure different LIBPROCESS_PORT to avoid conflict<br>
and any other options you want, I didn&#39;t do this so I&#39;m not sure if this \
works.<br> <br>
<br>
--<br>
Thanks,<br>
Chengwei<br>
<span><br>
&gt;<br>
&gt;<br>
&gt; I&#39;m curious to have your opinion on this :)<br>
&gt;<br>
&gt; Elouan Keryell-Even<br>
&gt; Software Engineer @ Atos Integration<br>
&gt; Toulouse, France<br>
&gt; <a href="tel:%2B33%206%2064%2061%2029%2056" value="+33664612956" \
target="_blank">+33 6 64 61 29 56</a><br> </span>&gt; SECURITY NOTE: file ~/.netrc \
must not be accessible by others<br> </blockquote></div><br><br \
clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- \
<br><div>Deshi Xiao<br>Twitter: xds2000<br>E-mail: xiaods(AT)<a \
href="http://gmail.com" target="_blank">gmail.com</a></div> </font></span></div>
</blockquote></div><br></div>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic