'Re: task has finished ,but keep resending TASK_RUNNING message'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       mesos-user
Subject:    Re: task has finished ,but keep resending TASK_RUNNING message
From:       Dario Rexin <drexin () apple ! com>
Date:       2017-04-29 18:21:57
Message-ID: 60CC461A-CE3A-4E43-A83B-CA199344CC70 () apple ! com
[Download RAW message or body]

Hey,

Mesos keeps resending status updates until they are acknowledged. Just call \
`driver.acknowledge(status)` and it should stop sending them.

--
Dario

> On Apr 29, 2017, at 9:07 AM, 梦开始的地方 <382607308@qq.com> wrote:
> 
> Hi,I write a simple scheduler,task finished but keep resending TASK_RUNNING \
> message,please help me. 
> I0429 21:44:13.847404 18617 slave.cpp:2191] Sending queued task \
> 'ee4c678e-2ce1-11e7-a577-00e081ddc51b0' to executor 'ee4c \
> 678e-2ce1-11e7-a577-00e081ddc51b0' of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 at executor(1)@10.61.22.6:43536 I0429 \
> 21:44:13.855125 18588 slave.cpp:3634] Handling status update TASK_RUNNING (UUID: \
> d6e6a709-76b3-4809-920f-64ece18523 be) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 from executor(1 )@10.61.22.6:43536
> I0429 21:44:13.856405 18603 status_update_manager.cpp:323] Received status update \
> TASK_RUNNING (UUID: d6e6a709-76b3-4809- 920f-64ece18523be) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:44:13.856853 18603 \
> status_update_manager.cpp:832] Checkpointing UPDATE for status update TASK_RUNNING \
> (UUID: d6e 6a709-76b3-4809-920f-64ece18523be) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework b932c5de-6423-498f-82e7-b1 \
> 5b9aa9b0d0-0078 I0429 21:44:13.857128 18586 slave.cpp:4051] Forwarding the update \
> TASK_RUNNING (UUID: d6e6a709-76b3-4809-920f-64ece18523b e) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
>                 b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 to master@10.170
> .15.211:5050
> I0429 21:44:13.857350 18586 slave.cpp:3961] Sending acknowledgement for status \
> update TASK_RUNNING (UUID: d6e6a709-76b3-4 809-920f-64ece18523be) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0 078 to executor(1)@10.61.22.6:43536
> I0429 21:44:13.958592 18596 slave.cpp:3634] Handling status update TASK_FINISHED \
> (UUID: 40b43ebf-ab44-4b04-9e08-27b76409b d14) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 from executor( 1)@10.61.22.6:43536
> I0429 21:44:13.960683 18585 memory.cpp:199] Updated 'memory.soft_limit_in_bytes' to \
>                 32MB for container 3a1b9ac6-c83a-49bd
> -add2-ee0cc55f282f
> I0429 21:44:13.961642 18585 cpu.cpp:101] Updated 'cpu.shares' to 102 (cpus 0.1) for \
> container 3a1b9ac6-c83a-49bd-add2-ee0 cc55f282f
> I0429 21:44:13.962314 18588 status_update_manager.cpp:323] Received status update \
>                 TASK_FINISHED (UUID: 40b43ebf-ab44-4b04
> -9e08-27b76409bd14) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:44:13.962380 18588 \
> status_update_manager.cpp:832] Checkpointing UPDATE for status update TASK_FINISHED \
> (UUID: 40 b43ebf-ab44-4b04-9e08-27b76409bd14) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework b932c5de-6423-498f-82e7-b \
> 15b9aa9b0d0-0078 I0429 21:44:13.962594 18614 slave.cpp:3961] Sending \
> acknowledgement for status update TASK_FINISHED (UUID: 40b43ebf-ab44- \
> 4b04-9e08-27b76409bd14) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0- 0078 to executor(1)@10.61.22.6:43536
> I0429 21:44:14.959496 18621 slave.cpp:4179] Got exited event for \
> executor(1)@10.61.22.6:43536 I0429 21:44:15.032075 18618 containerizer.cpp:2313] \
> Container 3a1b9ac6-c83a-49bd-add2-ee0cc55f282f has exited I0429 21:44:15.032115 \
> 18618 containerizer.cpp:1950] Destroying container \
> 3a1b9ac6-c83a-49bd-add2-ee0cc55f282f in RUNNING state
> I0429 21:44:15.032392 18616 linux_launcher.cpp:498] Asked to destroy container \
> 3a1b9ac6-c83a-49bd-add2-ee0cc55f282f I0429 21:44:15.032966 18616 \
> linux_launcher.cpp:541] Using freezer to destroy cgroup \
> mesos/3a1b9ac6-c83a-49bd-add2-ee0cc55 f282f
> I0429 21:44:15.034137 18607 cgroups.cpp:2705] Freezing cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd-add2-ee0cc5 5f282f
> I0429 21:44:15.035627 18615 cgroups.cpp:1439] Successfully froze cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd-a dd2-ee0cc55f282f after 1.437184ms
> I0429 21:44:15.037181 18580 cgroups.cpp:2723] Thawing cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd-add2-ee0cc55 f282f
> I0429 21:44:15.038635 18588 cgroups.cpp:1468] Successfully thawed cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd- add2-ee0cc55f282f after 1408us
> I0429 21:44:15.087050 18620 slave.cpp:4542] Executor \
> 'ee4c678e-2ce1-11e7-a577-00e081ddc51b0' of framework b932c5de-6423-4 \
> 98f-82e7-b15b9aa9b0d0-0078 exited with status 0 W0429 21:44:23.857220 18577 \
> status_update_manager.cpp:478] Resending status update TASK_RUNNING (UUID: \
>                 d6e6a709-76b3-4809
> -920f-64ece18523be) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:44:23.857573 18588 \
> slave.cpp:4051] Forwarding the update TASK_RUNNING (UUID: \
> d6e6a709-76b3-4809-920f-64ece18523b e) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 to master@10.170.15.211:5050 I0429 \
> 21:44:13.857350 18586 slave.cpp:3961] Sending acknowledgement for status update \
> TASK_RUNNING (UUID: d6e6a709-76b3-4 809-920f-64ece18523be) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0 078 to executor(1)@10.61.22.6:43536
> I0429 21:44:13.958592 18596 slave.cpp:3634] Handling status update TASK_FINISHED \
> (UUID: 40b43ebf-ab44-4b04-9e08-27b76409b d14) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 from executor( 1)@10.61.22.6:43536
> I0429 21:44:13.960683 18585 memory.cpp:199] Updated 'memory.soft_limit_in_bytes' to \
>                 32MB for container 3a1b9ac6-c83a-49bd
> -add2-ee0cc55f282f
> I0429 21:44:13.961642 18585 cpu.cpp:101] Updated 'cpu.shares' to 102 (cpus 0.1) for \
> container 3a1b9ac6-c83a-49bd-add2-ee0 cc55f282f
> I0429 21:44:13.962314 18588 status_update_manager.cpp:323] Received status update \
>                 TASK_FINISHED (UUID: 40b43ebf-ab44-4b04
> -9e08-27b76409bd14) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:44:13.962380 18588 \
> status_update_manager.cpp:832] Checkpointing UPDATE for status update TASK_FINISHED \
> (UUID: 40 b43ebf-ab44-4b04-9e08-27b76409bd14) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework b932c5de-6423-498f-82e7-b \
> 15b9aa9b0d0-0078 I0429 21:44:13.962594 18614 slave.cpp:3961] Sending \
> acknowledgement for status update TASK_FINISHED (UUID: 40b43ebf-ab44- \
> 4b04-9e08-27b76409bd14) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0- 0078 to executor(1)@10.61.22.6:43536
> I0429 21:44:14.959496 18621 slave.cpp:4179] Got exited event for \
> executor(1)@10.61.22.6:43536 I0429 21:44:15.032075 18618 containerizer.cpp:2313] \
> Container 3a1b9ac6-c83a-49bd-add2-ee0cc55f282f has exited I0429 21:44:15.032115 \
> 18618 containerizer.cpp:1950] Destroying container \
> 3a1b9ac6-c83a-49bd-add2-ee0cc55f282f in RUNNING state
> I0429 21:44:15.032392 18616 linux_launcher.cpp:498] Asked to destroy container \
> 3a1b9ac6-c83a-49bd-add2-ee0cc55f282f I0429 21:44:15.032966 18616 \
> linux_launcher.cpp:541] Using freezer to destroy cgroup \
> mesos/3a1b9ac6-c83a-49bd-add2-ee0cc55 f282f
> I0429 21:44:15.034137 18607 cgroups.cpp:2705] Freezing cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd-add2-ee0cc5 5f282f
> I0429 21:44:15.035627 18615 cgroups.cpp:1439] Successfully froze cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd-a dd2-ee0cc55f282f after 1.437184ms
> I0429 21:44:15.037181 18580 cgroups.cpp:2723] Thawing cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd-add2-ee0cc55 f282f
> I0429 21:44:15.038635 18588 cgroups.cpp:1468] Successfully thawed cgroup \
> /sys/fs/cgroup/freezer/mesos/3a1b9ac6-c83a-49bd- add2-ee0cc55f282f after 1408us
> I0429 21:44:15.087050 18620 slave.cpp:4542] Executor \
> 'ee4c678e-2ce1-11e7-a577-00e081ddc51b0' of framework b932c5de-6423-4 \
> 98f-82e7-b15b9aa9b0d0-0078 exited with status 0 W0429 21:44:23.857220 18577 \
> status_update_manager.cpp:478] Resending status update TASK_RUNNING (UUID: \
>                 d6e6a709-76b3-4809
> -920f-64ece18523be) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:44:23.857573 18588 \
> slave.cpp:4051] Forwarding the update TASK_RUNNING (UUID: \
> d6e6a709-76b3-4809-920f-64ece18523b e) for task  \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
>                 b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 to master@10.170
> .15.211:5050
> 
> W0429 21:45:23.861515 18605 status_update_manager.cpp:478] Resending status update \
>                 TASK_RUNNING (UUID: d6e6a709-76b3-4809
> -920f-64ece18523be) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:45:23.861879 18576 \
> slave.cpp:4051] Forwarding the update TASK_RUNNING (UUID: \
> d6e6a709-76b3-4809-920f-64ece18523b e) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
>                 b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 to master@10.170
> .15.211:5050
> I0429 21:45:33.658702 18577 slave.cpp:5044] Current disk usage 16.49%. Max allowed \
> age: 5.145383806205000days I0429 21:46:33.662861 18612 slave.cpp:5044] Current disk \
> usage 16.50%. Max allowed age: 5.145342357738299days W0429 21:46:43.865744 18613 \
> status_update_manager.cpp:478] Resending status update TASK_RUNNING (UUID: \
>                 d6e6a709-76b3-4809
> -920f-64ece18523be) for task ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
> b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 I0429 21:46:43.866065 18607 \
> slave.cpp:4051] Forwarding the update TASK_RUNNING (UUID: \
> d6e6a709-76b3-4809-920f-64ece18523b e) for task \
> ee4c678e-2ce1-11e7-a577-00e081ddc51b0 of framework \
>                 b932c5de-6423-498f-82e7-b15b9aa9b0d0-0078 to master@10.170
> .15.211:5050
> 
> please help me,thanks
> 
> 
> 


[prev in list] [next in list] [prev in thread] [next in thread]
Configure | About | News | Add a list | Sponsored by KoreLogic