[prev in list] [next in list] [prev in thread] [next in thread]
List: openmosix-general
Subject: Fwd: [openMosix-general] strange memory behavior with oM
From: jafarim <jafarim () gmail ! com>
Date: 2006-06-01 11:42:26
Message-ID: bddd3c950606010430t10a75b4bo36a5cb70a97b77b9 () mail ! gmail ! com
[Download RAW message or body]
---------- Forwarded message ----------
From: jafarim <jafarim@gmail.com>
Date: May 31, 2006 1:04 PM
Subject: Re: [openMosix-general] strange memory behavior with oM
To: moshe@moshebar.com
I have a written a small program that acts as a scheduler. It gets a list of
job to be run and then selects a small portion of these jobs and runs them
on the cluster. The jobs are of two kind. Type-1 jobs are generators that
generate a file which type-2 jobs then consume. I use Qt 4.1.2 for wirting
the scheduler and there may be memory leaks as I am not a very skilled
programmer. But if you remeber I said that even when I stop this scheduler
the memory is not freed and this is only happening on remote nodes and not
the home node where I start the scheduler. The memory is seemingly allocated
to kernel as the total memory of all processes (as shown in top) is very low
and insignificant.
On 5/31/06, Moshe Bar <moshe@moshebar.com> wrote:
>
> I was not aware of memory leaks for 2.4.26. What kind of app are you
> running? What libraries does it use?
>
> Moshe
>
> -----Original Message-----
> From: openmosix-general-admin@lists.sourceforge.net
> [mailto:openmosix-general-admin@lists.sourceforge.net] On Behalf Of
> jafarim
> Sent: Tuesday, May 30, 2006 9:20 AM
> To: openmosix-general@lists.sourceforge.net
> Subject: [openMosix-general] strange memory behavior with oM
>
> Hi
> I encountered a very strange problem with openMosix recently. I have a
> 3-node cluster with dual AMD Opteron CPUs and 1 GB of memory each. My
> cluster is based on Fedora Ccore 1 on which I have installed openMosix
> rpms
> (2.4.26). I have a small manager which queus jobs and starts them on
> random
> nodes by using mosrun.
> The problem is that when there is a large load on the cluster, the memory
> used by kernel grows gradually (even to 512 MB after hours of load).
> Restarting my manager program or even openMosix daemon does not help and
> the
> only treatment is to reboot the nodes. I was firstly suspicious about
> memory
> leak in my manager program but the most strange observation is that this
> memory growth does not happen on the node where my manager program resides
>
> (and starts other jobs) and that node's memory is quite normal. I verified
> this observation by moving my manager program to some other nodes in the
> cluster.
> Any ideas?
>
>
>
> -------------------------------------------------------
> All the advantages of Linux Managed Hosting--Without the Cost and Risk!
> Fully trained technicians. The highest number of Red Hat certifications in
> the hosting industry. Fanatical Support. Click to learn more
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=107521&bid=248729&dat=121642
> _______________________________________________
> openMosix-general mailing list
> openMosix-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/openmosix-general
>
[Attachment #3 (text/html)]
<br><br>---------- Forwarded message ----------<br><span class="gmail_quote">From: <b \
class="gmail_sendername">jafarim</b> <<a \
href="mailto:jafarim@gmail.com">jafarim@gmail.com</a>><br>Date: May 31, 2006 1:04 \
PM<br>Subject: Re: [openMosix-general] strange memory behavior with oM <br>To: <a \
href="mailto:moshe@moshebar.com">moshe@moshebar.com</a><br><br></span><div>I have a \
written a small program that acts as a scheduler. It gets a list of job to be run and \
then selects a small portion of these jobs and runs them on the cluster. The jobs are \
of two kind. Type-1 jobs are generators that generate a file which type-2 jobs then \
consume. I use Qt 4.1.2 for wirting the scheduler and there may be memory leaks as I \
am not a very skilled programmer. But if you remeber I said that even when I stop \
this scheduler the memory is not freed and this is only happening on remote nodes and \
not the home node where I start the scheduler. The memory is seemingly allocated to \
kernel as the total memory of all processes (as shown in top) is very low and \
insignificant. </div><div><span class="e" \
id="q_10b8994405a51b27_1"><br><br><div><span class="gmail_quote">On 5/31/06, <b \
class="gmail_sendername">Moshe Bar</b> <<a href="mailto:moshe@moshebar.com" \
target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> \
moshe@moshebar.com</a>> wrote:</span><blockquote class="gmail_quote" \
style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; \
padding-left: 1ex;"> I was not aware of memory leaks for 2.4.26. What kind of app are \
you<br>running? What libraries does it use?<br><br>Moshe<br><br>-----Original \
Message-----<br>From: <a href="mailto:openmosix-general-admin@lists.sourceforge.net" \
target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
openmosix-general-admin@lists.sourceforge.net</a><br>[mailto:<a \
href="mailto:openmosix-general-admin@lists.sourceforge.net" target="_blank" \
onclick="return top.js.OpenExtLink(window,event,this)">openmosix-general-admin@lists.sourceforge.net
</a>] On Behalf Of jafarim<br>Sent: Tuesday, May 30, 2006 9:20 AM
<br>To: <a href="mailto:openmosix-general@lists.sourceforge.net" target="_blank" \
onclick="return top.js.OpenExtLink(window,event,this)">openmosix-general@lists.sourceforge.net</a><br>Subject: \
[openMosix-general] strange memory behavior with oM <br><br>Hi<br>I encountered a \
very strange problem with openMosix recently. I have a <br>3-node cluster with dual \
AMD Opteron CPUs and 1 GB of memory each. My<br>cluster is based on Fedora Ccore 1 on \
which I have installed openMosix rpms<br>(2.4.26). I have a small manager which queus \
jobs and starts them on random <br>nodes by using mosrun.<br>The problem is that when \
there is a large load on the cluster, the memory<br>used by kernel grows gradually \
(even to 512 MB after hours of load).<br>Restarting my manager program or even \
openMosix daemon does not help and the <br>only treatment is to reboot the nodes. I \
was firstly suspicious about memory<br>leak in my manager program but the most \
strange observation is that this<br>memory growth does not happen on the node where \
my manager program resides <br>(and starts other jobs) and that node's memory is \
quite normal. I verified<br>this observation by moving my manager program to some \
other nodes in the<br>cluster.<br>Any \
ideas?<br><br><br><br>------------------------------------------------------- <br>All \
the advantages of Linux Managed Hosting--Without the Cost and Risk!<br>Fully trained \
technicians. The highest number of Red Hat certifications in<br>the hosting industry. \
Fanatical Support. Click to learn more<br>
<a href="http://sel.as-us.falkag.net/sel?cmd=lnk&kid=107521&bid=248729&dat=121642" \
target="_blank" onclick="return \
top.js.OpenExtLink(window,event,this)">http://sel.as-us.falkag.net/sel?cmd=lnk&kid=107521&bid=248729&dat=121642
</a><br>_______________________________________________
<br>openMosix-general mailing list<br><a \
href="mailto:openMosix-general@lists.sourceforge.net" target="_blank" onclick="return \
top.js.OpenExtLink(window,event,this)">openMosix-general@lists.sourceforge.net</a><br><a \
href="https://lists.sourceforge.net/lists/listinfo/openmosix-general" target="_blank" \
onclick="return top.js.OpenExtLink(window,event,this)"> \
https://lists.sourceforge.net/lists/listinfo/openmosix-general \
</a><br></blockquote></div><br>
</span></div>
-------------------------------------------------------
All the advantages of Linux Managed Hosting--Without the Cost and Risk!
Fully trained technicians. The highest number of Red Hat certifications in
the hosting industry. Fanatical Support. Click to learn more
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=107521&bid=248729&dat=121642
_______________________________________________
openMosix-general mailing list
openMosix-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/openmosix-general
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic