[prev in list] [next in list] [prev in thread] [next in thread] 

List:       gallery-devel
Subject:    [Gallery-devel] Identifying search engine crawlers
From:       Don Seiler <don () seiler ! us>
Date:       2006-05-15 19:02:13
Message-ID: 4468D035.3020108 () seiler ! us
[Download RAW message or body]

Per bug #1469384, I just added another crawler (ConveraCrawler) to the 
list in GalleryUtilities::identifySearchEngine().

The user brings up a good point, and perhaps it has been discussed 
previously, but is there possibly a better, more pro-active way to 
identify search crawlers?  Right now we can update 
GalleryUtilities.class, but then most users won't get the change until 
the next release.

Normally it probably wouldn't matter, but users that have my Ratings 
module loaded and allow Everyone to submit ratings will find that an 
unidentified search engine crawler will submit hundreds to thousands of 
ratings.

Secondary to this would be me getting back on the Gallery horse and 
adding some kind of admin interface to Ratings to allow an admin to 
prune unwanted ratings.  Again that is re-active.

Perhaps we could store the identified crawler UserAgent strings in the 
database, and allow admins to add more as he/she sees them?  We could 
then allow them to report new ones to us to update our stock install.

Don.
-- 
Don Seiler
don@seiler.us


-------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
__[ g a l l e r y - d e v e l ]_________________________

[ list info/archive --> http://gallery.sf.net/lists.php ]
[ gallery info/FAQ/download --> http://gallery.sf.net ]
[prev in list] [next in list] [prev in thread] [next in thread]