[prev in list] [next in list] [prev in thread] [next in thread]
List: webmin-l
Subject: Re: [webmin-l] limit memory usage of Webmin Filesystem Backup?
From: Jamie Cameron <jcameron () webmin ! com>
Date: 2013-03-14 23:54:53
Message-ID: wrtmdqde3jfpc0ywcnwe8qt0.1363305293345 () email ! android ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
[Attachment #4 (text/plain)]
In that case I think you'd have to be running top when the backup fails to figure out \
what is using so much RAM.
Doc Holiday <arztferien@googlemail.com> wrote:
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_mar
> -
> Forwarded by the Webmin mailing list at webadmin-list@lists.sourceforge.net
> To remove yourself from this list, go to
> http://lists.sourceforge.net/lists/listinfo/webadmin-list
[Attachment #5 (text/html)]
In that case I think you'd have to be running top when the backup fails to figure \
out what is using so much RAM. <br><br>Doc Holiday <arztferien@googlemail.com> \
wrote:<br><br>According to the cronjob list there is nothing else and the logs \
don't mention anything else either.<br>Very strange...<br><br><div \
class="gmail_quote">2013/3/14 Jamie Cameron <span dir="ltr"><<a \
href="mailto:jcameron@webmin.com" \
target="_blank">jcameron@webmin.com</a>></span><br> <blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><p>No, it should run the exact same code if you start the \
backup manually vs on schedule.<br><br>Perhaps something else is running at the same \
time as the backup and consuming all your RAM? </p>
<p>On 14/Mar/2013 14:02 Doc Holiday <<a href="mailto:arztferien@googlemail.com" \
target="_blank">arztferien@googlemail.com</a>> wrote .. </p><div \
class="HOEnZb"><div class="h5"> <blockquote type="cite">
Alright, now I'm irritated.<br>I stood overtime and manually started the backup \
via webmin. I frequently checked top ... and the backup went through all fine.<br>No \
high memory or CPU usage at all.<br>I really don't know what is going on, as the \
backup failed / the server crashed due to killed processes for about six times in a \
row before.<br> <br>Is there any difference when the backup is started \
manually?<br><br>Regards, Doc<br><br><br> <div class="gmail_quote">2013/3/13 Doc \
Holiday <span dir="ltr"><<a \
href="http://reply_mail.cgi?new=1&to=arztferien%40googlemail%2Ecom" \
target="_blank">arztferien@googlemail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left-width:1px;border-left-color:#cccccc;border-left-style:solid;padding-left:1ex">
<div class="gmail_quote">Quite difficult as the server is not at my place and \
I'm asleep at that time ;-)<br>But I will check if there's the possibility to \
run the backup on an evening when everybody else has gone.<br> <br>Could take some \
days though to find a good time.<br><br>Thank you very much so far for your quick \
answers!<br><br><br>Regards, Doc<br><br>2013/3/13 Jamie Cameron <span \
dir="ltr"><<a href="http://reply_mail.cgi?new=1&to=jcameron%40webmin%2Ecom" \
target="_blank">jcameron@webmin.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left-width:1px;border-left-color:#cccccc;border-left-style:solid;padding-left:1ex">
<div>
<div>To see which process is responsible, you would need to run \
"top" when the backup is running and see which process is using up the most \
RAM. <br> <div>
<div><br><br>Doc Holiday <<a \
href="http://reply_mail.cgi?new=1&to=arztferien%40googlemail%2Ecom" \
target="_blank">arztferien@googlemail.com</a>> wrote:<br><br> <div \
class="gmail_quote">2013/3/13 Jamie Cameron <span dir="ltr"><<a \
href="http://reply_mail.cgi?new=1&to=jcameron%40webmin%2Ecom" \
target="_blank">jcameron@webmin.com</a>></span><br> <blockquote \
class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left-width:1px;border-left-color:#cccccc;border-left-style:solid;padding-left:1ex">
On 13/Mar/2013 06:37 Doc Holiday <<a \
href="http://reply_mail.cgi?new=1&to=arztferien%40googlemail%2Ecom" \
target="_blank">arztferien@googlemail.com</a>> wrote ..<br> <div>
<div>> Hi all,<br>
><br>
> I recently got the problem, that the Filesystem Backup took too much<br>
> memory, leading to errors and finally the system killing random processes<br>
> (one of them XFS). Is there any possibility to limit the memory usage?<br>
> System is running @32 Bit with 4GB Ram, so memory upgrade is not possible<br>
> (ok, it is with PAE, but that's not helping here).<br> <br> </div>
</div>That's surprising, as the filesystem backup just \
uses the tar command, which<br> doesn't really read anything into memory - it \
just reads and writes files on<br> disk.<br> <br>
Which specific process was using too much RAM? Was it <a href="http://backup.pl" \
target="_blank">backup.pl</a>, the tar command<br> or something else?<br> <br>
- Jamie<br>
</blockquote>
<div><br><br><br>Can I see that from the log?<br>The failure \
occured every sunday morning when the backup was running.<br>Around 10 to 30 minutes \
after it had started i have log messages like<br> <br>
------------------------------------<br> 05:00:01 crond[9660]: (root) CMD \
(/etc/webmin/fsdump/<a href="http://backup.pl" target="_blank">backup.pl</a> \
299291317990780)<br> 05:01:01 crond(pam_unix)[9690]: session opened for user root by \
(uid=0)<br>
05:01:01 crond(pam_unix)[9690]: session closed for user root<br> 05:11:30 kernel: \
oom-killer: gfp_mask=0xd0<br> 05:11:30 kernel: DMA per-cpu:<br> 05:11:30 kernel: \
cpu 0 hot: low 2, high 6, batch 1<br> 05:11:30 kernel: cpu 0 cold: low 0, high 2, \
batch 1<br>
05:11:30 kernel: cpu 1 hot: low 2, high 6, batch 1<br> 05:11:30 kernel: cpu 1 \
cold: low 0, high 2, batch 1<br> 05:11:30 kernel: Normal per-cpu:<br> 05:11:30 \
kernel: cpu 0 hot: low 32, high 96, batch 16<br> 05:11:30 kernel: cpu 0 cold: low 0, \
high 32, batch 16<br>
05:11:30 kernel: cpu 1 hot: low 32, high 96, batch 16<br> 05:11:30 kernel: cpu 1 \
cold: low 0, high 32, batch 16<br> 05:11:30 kernel: HighMem per-cpu:<br> 05:11:30 \
kernel: cpu 0 hot: low 32, high 96, batch 16<br> 05:11:31 kernel: cpu 0 cold: low 0, \
high 32, batch 16<br>
05:11:31 kernel: cpu 1 hot: low 32, high 96, batch 16<br> 05:11:31 kernel: cpu 1 \
cold: low 0, high 32, batch 16<br> 05:11:31 kernel:<br> 05:11:31 kernel: Free \
pages: 1992kB (1664kB HighMem)<br> 05:11:31 kernel: Active:233680 \
inactive:612475 dirty:274435 writeback:84289 unstable:0 free:498 slab:104597 \
mapped:71335 pagetables:3886<br> 05:11:31 kernel: DMA free:0kB min:16kB low:32kB \
high:48kB active:0kB inactive:1204kB present:16384kB<br> 05:11:31 kernel: \
protections[]: 0 0 0<br> 05:11:31 kernel: Normal free:328kB min:936kB low:1872kB \
high:2808kB active:88kB inactive:194376kB present:901120kB<br>
05:11:31 kernel: protections[]: 0 0 0<br> 05:11:31 kernel: HighMem free:1664kB \
min:512kB low:1024kB high:1536kB active:934632kB inactive:2254320kB \
present:3866624kB<br> 05:11:31 kernel: protections[]: 0 0 0<br> 05:11:31 kernel: \
DMA: 0*4kB 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB \
0*4096kB = 0kB<br>
05:11:31 kernel: Normal: 80*4kB 1*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB \
0*1024kB 0*2048kB 0*4096kB = 328kB<br> 05:11:31 kernel: HighMem: 78*4kB 73*8kB \
16*16kB 0*32kB 0*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 1664kB<br>
05:11:31 kernel: Swap cache: add 53086, delete 52005, find 32225/34698, race \
0+0<br> 05:11:31 kernel: Out of Memory: Killed process 2802 \
(oninit).<br>------------------------------------<br><br>Does that give you a \
clue?<br> <br>Regards, Doc <br></div>
</div><br>
</div>
</div><br>
</div>
</div>
<div>------------------------------------------------------------------------------<br>
Everyone hates slow websites. So do we.<br>
Make your web apps faster with AppDynamics<br>
Download AppDynamics Lite for free today:<br> <a \
href="http://p.sf.net/sfu/appdyn_d2d_mar" \
target="_blank">http://p.sf.net/sfu/appdyn_d2d_mar</a><br>-<br> Forwarded by the \
Webmin mailing list at <a \
href="http://reply_mail.cgi?new=1&to=webadmin%2Dlist%40lists%2Esourceforge%2Enet" \
target="_blank">webadmin-list@lists.sourceforge.net</a><br> To remove yourself from \
this list, go to<br> <a \
href="http://lists.sourceforge.net/lists/listinfo/webadmin-list" \
target="_blank">http://lists.sourceforge.net/lists/listinfo/webadmin-list</a><br> \
<br></div> </blockquote>
</div><br>
</blockquote>
</div><br>
</blockquote><br>
</div></div><br>------------------------------------------------------------------------------<br>
Everyone hates slow websites. So do we.<br>
Make your web apps faster with AppDynamics<br>
Download AppDynamics Lite for free today:<br>
<a href="http://p.sf.net/sfu/appdyn_d2d_mar" \
target="_blank">http://p.sf.net/sfu/appdyn_d2d_mar</a><br>-<br> Forwarded by the \
Webmin mailing list at <a \
href="mailto:webadmin-list@lists.sourceforge.net">webadmin-list@lists.sourceforge.net</a><br>
To remove yourself from this list, go to<br>
<a href="http://lists.sourceforge.net/lists/listinfo/webadmin-list" \
target="_blank">http://lists.sourceforge.net/lists/listinfo/webadmin-list</a><br> \
<br></blockquote></div><br>
------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_mar
-
Forwarded by the Webmin mailing list at webadmin-list@lists.sourceforge.net
To remove yourself from this list, go to
http://lists.sourceforge.net/lists/listinfo/webadmin-list
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic