Clean up Bots...

Andy Warner (andy@andy.net)
Thu, 4 Apr 1996 14:23:45 +0000

First off, is anybody running a 'bot dedicated purely to cleaning up
their database? If not, why not ? Also, how tough would it be to have a
user scheduled cleaning bot. I don't mean the tradtional go find the
delete entry page and submit the link that doesn't work. Why not
either have a link right there to automatically recheck the site or
have a script checking the referer logs for 404s (and other errors).
For every error site send the bot to verify the problem and delete
the entry if it is valid. 

-- 
Andy Warner                             andy@andy.net
01000001 01101110 01100100 01110010 01100101 01110111 
01010111 01100001 01110010 01101110 01100101 01110010 
http://www.andy.net/~andy/        http://www.dorm.net