[prev in list] [next in list] [prev in thread] [next in thread] 

List:       wget
Subject:    Re: Out of Memory Error
From:       oscaruser () programmer ! net
Date:       2006-05-25 22:53:14
Message-ID: 20060525225314.CF29D115820 () ws1-7 ! us4 ! outblaze ! com
[Download RAW message or body]

~/wget/bin/wget -d --recursive --cookies=on --wait=2 --delete-after --no-directories \
--reject css,js,jpg,gif "http://192.168.1.101" 2>&1 | gzip > log.0.gz

system is dual xeon

thanks

cat /proc/cpuinfo 
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 15
model           : 4
model name      : Intel(R) Xeon(TM) CPU 2.80GHz
stepping        : 3
cpu MHz         : 2801.658
cache size      : 16 KB
physical id     : 0
siblings        : 2
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 5
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat \
pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm pni monitor ds_cpl cid \
bogomips        : 5521.40

processor       : 1
vendor_id       : GenuineIntel
cpu family      : 15
model           : 4
model name      : Intel(R) Xeon(TM) CPU 2.80GHz
stepping        : 3
cpu MHz         : 2801.658
cache size      : 16 KB
physical id     : 0
siblings        : 2
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 5
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat \
pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm pni monitor ds_cpl cid \
bogomips        : 5586.94

processor       : 2
vendor_id       : GenuineIntel
cpu family      : 15
model           : 4
model name      : Intel(R) Xeon(TM) CPU 2.80GHz
stepping        : 3
cpu MHz         : 2801.658
cache size      : 16 KB
physical id     : 3
siblings        : 2
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 5
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat \
pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm pni monitor ds_cpl cid \
bogomips        : 5586.94

processor       : 3
vendor_id       : GenuineIntel
cpu family      : 15
model           : 4
model name      : Intel(R) Xeon(TM) CPU 2.80GHz
stepping        : 3
cpu MHz         : 2801.658
cache size      : 16 KB
physical id     : 3
siblings        : 2
fdiv_bug        : no
hlt_bug         : no
f00f_bug        : no
coma_bug        : no
fpu             : yes
fpu_exception   : yes
cpuid level     : 5
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat \
pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm pni monitor ds_cpl cid \
bogomips        : 5586.94

> ----- Original Message -----
> From: sms@antinode.org 
> To: oscaruser@programmer.net
> Subject: Re: Out of Memory Error
> Date: Thu, 25 May 2006 16:05:15 -0500 (CDT)
> 
> 
> oscaruser@programmer.net:
> 
> > [...]  For very big runs, I wouldn't want to convert large amounts =
> > of disk free space to swap space because that reduces the 
> usability of the =
> > system (did I need to give a reason why? :-) unless I am 
> missing something.=
> 
> 
> You didn't say, but I assume that this is some PC-like system, so
> that adding 100GB of disk space (for swap) would cost, what, $50?
> 
> Not knowing the Wget command you used, I'd also suggest not trying to
> do the whole site with one Wget command.  If one job is too big, try
> many smaller jobs.
> 
> ------------------------------------------------------------------------
> 
> Steven M. Schweda               sms@antinode.org
> 382 South Warwick Street        (+1) 651-699-9818
> Saint Paul  MN  55105-2547


-- 
___________________________________________________
Play 100s of games for FREE! http://games.mail.com/


[prev in list] [next in list] [prev in thread] [next in thread]