[prev in list] [next in list] [prev in thread] [next in thread] 

List:       nutch-general
Subject:    [Nutch-general] Crawl performance v0.7 vs v0.8
From:       Doug Cook <nabble () candiru ! com>
Date:       2006-06-28 0:37:39
Message-ID: 5076720.post () talk ! nabble ! com
[Download RAW message or body]


Hi, I'm experimenting with switching to v0.8 because of the richer set of
plugins, and from this point of view, it's great, but so far I have seen
much lower crawl performance, and I'm hoping it's just a matter of tuning
the right parameters.

I'm running on 1 4-CPU machine, and under 0.7 I could max out on bandwidth
at about 200 threads. Under 0.8, with the same number of threads, I am
seeing much lower, and very spiky, bandwidth usage, but I don't appear to be
bottlenecked out on any other resource. 

Any suggestions as to where I might look?

Thanks,

Doug
-- 
View this message in context: \
http://www.nabble.com/Crawl-performance-v0.7-vs-v0.8-tf1858879.html#a5076720 Sent \
from the Nutch - User forum at Nabble.com.


Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Nutch-general mailing list
Nutch-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-general


[prev in list] [next in list] [prev in thread] [next in thread]