[prev in list] [next in list] [prev in thread] [next in thread]
List: mesos-user
Subject: Re: setting roles in mesos 0.28
From: Stefano Bianchi <jazzista88 () gmail ! com>
Date: 2016-04-29 17:03:41
Message-ID: CANg9wmGsQUE_DqLJbdLXVcGAmKsMUDX50TdefOdeHjsi2yJRdw () mail ! gmail ! com
[Download RAW message or body]
this happen when i have 3 masters however.
2016-04-29 19:02 GMT+02:00 haosdent <haosdent@gmail.com>:
> >When a master is elected, after a minute it disconnect re-electing
> another master.
> Last week I use 0.28.1 to set up two masters in same server + a docker
> containered zookeeper. It works fine for me and could not reproduce the
> question you mentioned before. But I would continue to try reproduce it
> again in multiple vms tomorrow. By the way, no idea why your thread mix
> with "settings roles in mesos 0.28"~
>
> On Fri, Apr 29, 2016 at 5:11 PM, Stefano Bianchi <jazzista88@gmail.com>
> wrote:
>
>> I notice from mates of mine, several issues with mesos 0.28.1. Specially
>> on the master election stability. When a master is elected, after a minute
>> it disconnect re-electing another master.
>> Anyone of you have this issue?
>> This is not my issue, since im running 0.27.2 which is much more stable.
>> Il 25/apr/2016 11:33, "Adam Bordelon" <adam@mesosphere.io> ha scritto:
>>
>>> Seems like you're trying to start Marathon with multiple Mesos roles
>>> "spark;sparkr;ms;qa", but Marathon may be interpreting this as a single
>>> role that happens to include semi-colons. Mesos does not yet support
>>> multiple roles in a single framework. See
>>> https://issues.apache.org/jira/browse/MESOS-1763
>>> Note that the acceptedResourceRoles feature in Marathon currently only
>>> applies to the "*" (unreserved) role vs. the value of --mesos_role
>>>
>>> On Wed, Apr 20, 2016 at 5:19 AM, Rodrick Brown <rodrick@orchard-app.com>
>>> wrote:
>>>
>>>> On Apr 20 2016, at 1:36 am, Jian Qiu <gothicqiujian@gmail.com> wrote:
>>>>
>>>>> It is not necessary to configure --role on master. Actually it should
>>>>> work if you configure --default_role='sparkr' on agent and start marathon
>>>>> with --mesos_role=sparkr. Which version of mesos are you using? And could
>>>>> you attach the master log?
>>>>>
>>>>
>>>> This is Marathon 0.15 and Mesos 0.28.1
>>>>
>>>> on my masters I have the following attribute set
>>>> $ cat /etc/marathon/conf/mesos_role
>>>> spark;sparkr;ms;qa
>>>>
>>>> On the slave I have the following set in the agent
>>>> $ cat /etc/mesos-slave/default_role
>>>> sparkr
>>>>
>>>> $ cat /etc/mesos-slave/resources
>>>> cpus:10;mem:100000
>>>>
>>>> $ cat attributes
>>>> rack:sparkr
>>>>
>>>> I'm trying to launch a simple task from marathon on this agent with
>>>> following configs
>>>>
>>>> $ cat rstudio-mesos-shuffle-server.marathon.json
>>>> {
>>>> "id": "/mesos/rstudio-shuffle-service",
>>>> "cmd": ". /opt/spark-1.6.1/conf/spark-env.sh .
>>>> /opt/spark-1.6.1/sbin/spark-config.sh && .
>>>> /opt/spark-1.6.1/bin/load-spark-env.sh && env &&
>>>> /opt/spark-1.6.1/bin/spark-class
>>>> org.apache.spark.deploy.mesos.MesosExternalShuffleService 1",
>>>> "cpus": 0.5,
>>>> "mem": 1524,
>>>> "disk": 100,
>>>> "user": "mesos",
>>>> "instances": 1,
>>>> "requirePorts": true,
>>>> "acceptedResourceRoles": ["sparkr"],
>>>> "ports":
>>>> [
>>>> 31338
>>>> ],
>>>> "constraints": [
>>>> [
>>>> "hostname","UNIQUE"
>>>> ],
>>>> [
>>>> "rack", "LIKE", "sparkr"
>>>> ]
>>>> ],
>>>> "env": {
>>>> "SPARK_HOME": "/opt/spark-1.6.1",
>>>> "SPARK_SCALA_VERSION": "2.11"
>>>> },
>>>> "healthChecks": [
>>>> {
>>>> "gracePeriodSeconds": 5,
>>>> "intervalSeconds": 10,
>>>> "maxConsecutiveFailures": 3,
>>>> "portIndex": 0,
>>>> "protocol": "TCP",
>>>> "timeoutSeconds": 5
>>>> }
>>>> ],
>>>> "maxLaunchDelaySeconds": 3,
>>>> "backoffFactor": 1.20,
>>>> "upgradeStrategy": {
>>>> "minimumHealthCapacity": 0.5,
>>>> "maximumOverCapacity": 0.5
>>>> }
>>>> }
>>>>
>>>> In the marathon logs this is what I see
>>>>
>>>> 20 12:11:42 prod-mesos-m-3.aws.xxx.com marathon[29617]: [2016-04-20
>>>> 12:11:42,807] INFO Offer ID:
>>>> [50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O13166461]. Considered resources with
>>>> roles: [sparkr]. Not all basic resources satisfied: cpu not in offer, disk
>>>> not in offer, mem not in offer
>>>> (mesosphere.mesos.ResourceMatcher$:marathon-akka.actor.default-dispatcher-9)
>>>>
>>>> Thanks.
>>>>
>>>>
>>>>
>>>>> On Wed, Apr 20, 2016 at 11:11 AM, Rodrick Brown <
>>>>> rodrick@orchard-app.com> wrote:
>>>>>
>>>>> I'm confused do roles need to be configured on masters and slaves or
>>>>> just slaves?
>>>>> The docs says --roles has been deprecated on mesos-master but doesn't
>>>>> state an alternate method.
>>>>>
>>>>>
>>>>> on my slaves i'm using default_role='sparkr' and in marathon I've
>>>>> added --mesos_role=sparkr however I'm not able to get any tasks to run on
>>>>> this server do I need to set it on the masters also ?
>>>>>
>>>>> Please advise thanks.
>>>>>
>>>>> --RB
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> *Rodrick Brown* / Systems Engineer
>>>>>
>>>>> +1 917 445 6839 / rodrick@orchardplatform.com
>>>>> <charlie@orchardplatform.com>
>>>>>
>>>>> *Orchard Platform*
>>>>>
>>>>> 101 5th Avenue, 4th Floor, New York, NY 10003
>>>>>
>>>>> http://www.orchardplatform.com
>>>>>
>>>>> Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace
>>>>> Lending Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/>
>>>>>
>>>>> *NOTICE TO RECIPIENTS*: This communication is confidential and
>>>>> intended for the use of the addressee only. If you are not an intended
>>>>> recipient of this communication, please delete it immediately and notify
>>>>> the sender by return email. Unauthorized reading, dissemination,
>>>>> distribution or copying of this communication is prohibited. This
>>>>> communication does not constitute an offer to sell or a solicitation of an
>>>>> indication of interest to purchase any loan, security or any other
>>>>> financial product or instrument, nor is it an offer to sell or a
>>>>> solicitation of an indication of interest to purchase any products or
>>>>> services to any persons who are prohibited from receiving such information
>>>>> under applicable law. The contents of this communication may not
>>>>> be accurate or complete and are subject to change without notice. As such,
>>>>> Orchard App, Inc. (including its subsidiaries and affiliates, "Orchard")
>>>>> makes no representation regarding the accuracy or completeness of the
>>>>> information contained herein. The intended recipient is advised to consult
>>>>> its own professional advisors, including those specializing in legal, tax
>>>>> and accounting matters. Orchard does not provide legal, tax or accounting
>>>>> advice.
>>>>>
>>>>>
>>>>>
>>>> *NOTICE TO RECIPIENTS*: This communication is confidential and
>>>> intended for the use of the addressee only. If you are not an intended
>>>> recipient of this communication, please delete it immediately and
>>>> notify the sender by return email. Unauthorized reading, dissemination,
>>>> distribution or copying of this communication is prohibited. This
>>>> communication does not constitute an offer to sell or a solicitation
>>>> of an indication of interest to purchase any loan, security or any other
>>>> financial product or instrument, nor is it an offer to sell or a
>>>> solicitation of an indication of interest to purchase any products or
>>>> services to any persons who are prohibited from receiving such information
>>>> under applicable law. The contents of this communication may not
>>>> be accurate or complete and are subject to change without notice. As such,
>>>> Orchard App, Inc. (including its subsidiaries and affiliates, "Orchard")
>>>> makes no representation regarding the accuracy or completeness of the
>>>> information contained herein. The intended recipient is advised to consult
>>>> its own professional advisors, including those specializing in legal, tax
>>>> and accounting matters. Orchard does not provide legal, tax or
>>>> accounting advice.
>>>>
>>>
>>>
>
>
> --
> Best Regards,
> Haosdent Huang
>
[Attachment #3 (text/html)]
<div dir="ltr">this happen when i have 3 masters however.</div><div \
class="gmail_extra"><br><div class="gmail_quote">2016-04-29 19:02 GMT+02:00 haosdent \
<span dir="ltr"><<a href="mailto:haosdent@gmail.com" \
target="_blank">haosdent@gmail.com</a>></span>:<br><blockquote class="gmail_quote" \
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div \
dir="ltr"><span class="">><span style="font-size:12.8px">When a master is elected, \
after a minute it disconnect re-electing another master.</span></span><div><span \
style="font-size:12.8px">Last week I use 0.28.1 to set up two masters in same server \
+ a docker containered zookeeper. It works fine for me and could not reproduce the \
question you mentioned before. But I would continue to try reproduce it again in \
multiple vms tomorrow. By the way, no idea why your thread mix with "settings \
roles in mesos 0.28"~</span></div></div><div class="gmail_extra"><div><div \
class="h5"><br><div class="gmail_quote">On Fri, Apr 29, 2016 at 5:11 PM, Stefano \
Bianchi <span dir="ltr"><<a href="mailto:jazzista88@gmail.com" \
target="_blank">jazzista88@gmail.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><p dir="ltr">I notice from mates of mine, several issues with \
mesos 0.28.1. Specially on the master election stability. When a master is elected, \
after a minute it disconnect re-electing another master.<br> Anyone of you have this \
issue?<br> This is not my issue, since im running 0.27.2 which is much more \
stable.<br> </p><div><div>
<div class="gmail_quote">Il 25/apr/2016 11:33, "Adam Bordelon" <<a \
href="mailto:adam@mesosphere.io" target="_blank">adam@mesosphere.io</a>> ha \
scritto:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Seems like \
you're trying to start Marathon with multiple Mesos roles \
"spark;sparkr;ms;qa", but Marathon may be interpreting this as a single \
role that happens to include semi-colons. Mesos does not yet support multiple roles \
in a single framework. See <a href="https://issues.apache.org/jira/browse/MESOS-1763" \
target="_blank">https://issues.apache.org/jira/browse/MESOS-1763</a><br></div>Note \
that the acceptedResourceRoles feature in Marathon currently only applies to the \
"*" (unreserved) role vs. the value of --mesos_role<br></div><div \
class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 20, 2016 at 5:19 AM, \
Rodrick Brown <span dir="ltr"><<a href="mailto:rodrick@orchard-app.com" \
target="_blank">rodrick@orchard-app.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div><span><div><span style="line-height:1.4">On Apr 20 2016, \
at 1:36 am, Jian </span>Qiu<span style="line-height:1.4"> \
<</span>gothicqiujian<span style="line-height:1.4">@<a href="http://gmail.com" \
target="_blank">gmail.com</a>> wrote: </span><br></div></span><div \
class="gmail_quote"><span> <blockquote class="gmail_quote" style="margin:0 0 0 \
.8ex;border-left:1px #ccc solid;padding-left:1ex"> <div dir="ltr">It is not \
necessary to configure --role on master. Actually it should work if you configure \
--default_role='sparkr' on agent and start marathon with --mesos_role=sparkr. \
Which version of mesos are you using? And could you attach the master \
log?</div></blockquote><div class="gmail_quote"><br></div></span><div \
class="gmail_quote">This is Marathon 0.15 and Mesos 0.28.1 </div><div \
class="gmail_quote"><br></div><div class="gmail_quote">on my masters I have the \
following attribute set</div><div class="gmail_quote">$ cat \
/etc/marathon/conf/mesos_role<br>spark;sparkr;ms;qa</div><div \
class="gmail_quote"><br></div><div class="gmail_quote">On the slave I have the \
following set in the agent</div><div class="gmail_quote">$ cat \
/etc/mesos-slave/default_role<br>sparkr<br></div><div \
class="gmail_quote"><br></div><div class="gmail_quote">$ cat \
/etc/mesos-slave/resources<br>cpus:10;mem:100000<br></div><div \
class="gmail_quote"><br></div><div class="gmail_quote">$ cat \
attributes<br>rack:sparkr<br></div><div class="gmail_quote"><br></div><div \
class="gmail_quote">I'm trying to launch a simple task from marathon on this \
agent with following configs </div><div class="gmail_quote"><br></div><div \
class="gmail_quote">$ cat rstudio-mesos-shuffle-server.marathon.json<br></div><div \
class="gmail_quote">{<br> "id": \
"/mesos/rstudio-shuffle-service",<br> "cmd": ". \
/opt/spark-1.6.1/conf/spark-env.sh . /opt/spark-1.6.1/sbin/spark-config.sh && \
. /opt/spark-1.6.1/bin/load-spark-env.sh && env && \
/opt/spark-1.6.1/bin/spark-class \
org.apache.spark.deploy.mesos.MesosExternalShuffleService 1",<br> \
"cpus": 0.5,<br> "mem": 1524,<br> "disk": \
100,<br> "user": "mesos",<br> "instances": \
1,<br> "requirePorts": true,<br> \
"acceptedResourceRoles": ["sparkr"],<br> \
"ports":<br> [<br> 31338<br> ],<br> \
"constraints": [<br> [<br> \
"hostname","UNIQUE"<br> ],<br> [<br> \
"rack", "LIKE", "sparkr"<br> ]<br> ],<br> \
"env": {<br> "SPARK_HOME": \
"/opt/spark-1.6.1",<br> "SPARK_SCALA_VERSION": \
"2.11"<br> },<br> "healthChecks": [<br> {<br> \
"gracePeriodSeconds": 5,<br> "intervalSeconds": \
10,<br> "maxConsecutiveFailures": 3,<br> \
"portIndex": 0,<br> "protocol": "TCP",<br> \
"timeoutSeconds": 5<br> }<br> ],<br> \
"maxLaunchDelaySeconds": 3,<br> "backoffFactor": \
1.20,<br> "upgradeStrategy": {<br> \
"minimumHealthCapacity": 0.5,<br> "maximumOverCapacity": \
0.5<br> }<br>}<br></div><div class="gmail_quote"><br></div><div \
class="gmail_quote">In the marathon logs this is what I see </div><div \
class="gmail_quote"><br></div><div class="gmail_quote">20 12:11:42 <a \
href="http://prod-mesos-m-3.aws.xxx.com" \
target="_blank">prod-mesos-m-3.aws.xxx.com</a> marathon[29617]: [2016-04-20 \
12:11:42,807] INFO Offer ID: [50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O13166461]. \
Considered resources with roles: [sparkr]. Not all basic resources satisfied: cpu not \
in offer, disk not in offer, mem not in offer \
(mesosphere.mesos.ResourceMatcher$:marathon-akka.actor.default-dispatcher-9)<br></div><div \
class="gmail_quote"><br></div><div class="gmail_quote">Thanks. </div><div \
class="gmail_quote"><br></div></div><span><div \
class="gmail_quote"><div><br></div><blockquote class="gmail_quote" style="margin:0 0 \
0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><br></div><div>On Wed, \
Apr 20, 2016 at 11:11 AM, Rodrick Brown <span dir="ltr"><<a \
href="mailto:rodrick@orchard-app.com" \
target="_blank">rodrick@orchard-app.com</a>></span> wrote:<br><blockquote \
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>I'm \
confused do roles need to be configured on masters and slaves or just \
slaves?<div><div>The docs says --roles has been deprecated on mesos-master but \
doesn't state an alternate method. </div><div><br></div><div><br></div><div>on \
my slaves i'm using default_role='sparkr' and in marathon I've added \
--mesos_role=sparkr however I'm not able to get any tasks to run on this server \
do I need to set it on the masters also ? </div><div><br></div><div>Please advise \
thanks. </div><div><br></div><div>--RB </div><br></div><br><div><br></div>-- \
<p></p><p style="margin-bottom:0px;font-stretch:normal;font-size:10px;line-height:normal;font-family:Verdana;color:rgb(102,102,102)"><b>Rodrick \
Brown</b> / Systems Engineer </p><p \
style="margin-bottom:0px;font-stretch:normal;font-size:10px;line-height:normal;font-family:Verdana;color:rgb(0,148,94)"><a \
value="+19174456839">+1 917 445 6839</a> / <a \
href="mailto:charlie@orchardplatform.com" \
target="_blank">rodrick@orchardplatform.com</a></p><p \
style="margin-bottom:0px;font-stretch:normal;font-size:10px;line-height:normal;font-family:Verdana;color:rgb(102,102,102)"><b>Orchard \
Platform</b> </p><p \
style="margin-bottom:0px;font-stretch:normal;font-size:10px;line-height:normal;font-family:Verdana;color:rgb(102,102,102)">101 \
5th Avenue, 4th Floor, New York, NY 10003 </p><p \
style="margin-bottom:0px;font-stretch:normal;font-size:10px;line-height:normal;font-family:Verdana;color:rgb(0,148,94)"><a \
href="http://www.orchardplatform.com/" \
target="_blank">http://www.orchardplatform.com</a></p><p \
style="margin-bottom:0px;font-stretch:normal;font-size:10px;line-height:normal;font-family:Verdana;color:rgb(102,102,102)"><a \
href="http://www.orchardplatform.com/blog/" target="_blank">Orchard Blog</a> | <a \
href="http://www.meetup.com/Peer-to-Peer-Lending-P2P/" target="_blank">Marketplace \
Lending Meetup</a></p></div> <br>
<div><b>NOTICE TO RECIPIENTS</b>: This communication is confidential and intended for \
the use of the addressee only. If you are not an intended recipient of this \
communication, please delete it immediately and notify the sender by return email. \
Unauthorized reading, dissemination, distribution or copying of this communication is \
prohibited. This communication does not constitute an offer to sell or a \
solicitation of an indication of interest to purchase any loan, security or any other \
financial product or instrument, nor is it an offer to sell or a solicitation of an \
indication of interest to purchase any products or services to any persons who are \
prohibited from receiving such information under applicable law. The contents of this \
communication may not be accurate or complete and are subject to change without \
notice. As such, Orchard App, Inc. (including its subsidiaries and affiliates, \
"Orchard") makes no representation regarding the accuracy or completeness \
of the information contained herein. The intended recipient is advised to consult its \
own professional advisors, including those specializing in legal, tax and accounting \
matters. Orchard does not provide legal, tax or accounting \
advice.</div></blockquote></div><br></div> </blockquote>
</div></span></div><div><div>
<br>
<div><font size="1"><font><b>NOTICE TO RECIPIENTS</b>: This communication is \
confidential and intended for the use of the addressee only. If you are not an \
intended recipient of this communication, please delete it </font><font>immediately \
and notify the sender by return email. Unauthorized reading, dissemination, \
distribution or copying of this communication is prohibited. This communication does \
not </font>constitute an offer to sell or a solicitation of an indication of \
interest to purchase any loan, security or any other financial product or instrument, \
nor is it an offer to sell or a solicitation of an indication of interest to \
purchase any products or services to any persons who are prohibited from receiving \
such information under applicable law. The contents of this communication may not be \
accurate or complete and are subject to change without notice. As such, Orchard App, \
Inc. (including its subsidiaries and affiliates, "Orchard") makes no \
representation regarding the <font>accuracy or completeness of the information \
contained herein. The intended recipient is advised to consult its own professional \
advisors, including those specializing in legal, tax and accounting </font>matters. \
Orchard does not provide legal, tax or accounting \
advice.</font></div></div></div></blockquote></div><br></div> </blockquote></div>
</div></div></blockquote></div><br><br clear="all"><div><br></div></div></div><span \
class="HOEnZb"><font color="#888888">-- <br><div>Best Regards,<br><div>Haosdent \
Huang</div></div> </font></span></div>
</blockquote></div><br></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic