[prev in list] [next in list] [prev in thread] [next in thread] 

List:       hadoop-user
Subject:    Re: Yarn containers creating child process
From:       Ravi Prakash <ravihadoop () gmail ! com>
Date:       2017-02-13 17:17:18
Message-ID: CAMs9kVhWaAM96QNDRtq7qhs7x-30CEjW5W9qsb1LOyNrU7vYvA () mail ! gmail ! com
[Download RAW message or body]

Hi Sandesh!

A *yarn* task is just like any other process on the operating system.
Depending on which ContainerExecutor you use, you should launch the yarn
task with appropriate limits in place. Although I have never tried it, on
Linux you could use setrlimit or
https://www.kernel.org/doc/Documentation/cgroup-v1/pids.txt . What yarn
application are you planning on using? Or creating your own?

HTH
Ravi.

On Fri, Feb 10, 2017 at 4:03 PM, Sandesh Hegde <sandesh.hegde@gmail.com>
wrote:

> Hi,
>
> What are the features available to limit the Yarn containers from creating
> the child process?
>
> Thanks
>

[Attachment #3 (text/html)]

<div dir="ltr"><div><div><div>Hi Sandesh!<br><br></div>A *yarn* task is just like any \
other process on the operating system. Depending on which ContainerExecutor you use, \
you should launch the yarn task with appropriate limits in place. Although I have \
never tried it, on Linux you could use setrlimit or <a \
href="https://www.kernel.org/doc/Documentation/cgroup-v1/pids.txt">https://www.kernel.org/doc/Documentation/cgroup-v1/pids.txt</a> \
. What yarn application are you planning on using? Or creating your \
own?<br><br></div>HTH<br></div>Ravi.<br></div><div class="gmail_extra"><br><div \
class="gmail_quote">On Fri, Feb 10, 2017 at 4:03 PM, Sandesh Hegde <span \
dir="ltr">&lt;<a href="mailto:sandesh.hegde@gmail.com" \
target="_blank">sandesh.hegde@gmail.com</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>What are the features \
available to limit the Yarn containers from creating the child \
process?</div><div><br></div><div>Thanks</div></div> </blockquote></div><br></div>



[prev in list] [next in list] [prev in thread] [next in thread]