roverbot - perhaps the worst robot yet

dws (dws@intercom.com)
Thu, 27 Jun 1996 13:02:20 -0400 (EDT)


I'm beginning to disdain it when a new spider hits my website...

About 40 hours ago I received the following hits on http://:

www.roverbot.com [25/Jun/1996:20:45:02 /robots.txt - "Roverbot "
www.roverbot.com [25/Jun/1996:20:45:03 /isdn/isdnfaq3.htm - "Roverbot "
www.roverbot.com [25/Jun/1996:20:49:52 /robots.txt - "Roverbot "
www.roverbot.com [25/Jun/1996:20:49:53 /isdn/isdnfaq1.htm - "Roverbot "

Curiously I decided to check out that web page...This is how I am greeted:

Welcome to Rover

Rover is a unique Internet research tool that generates
custom email mailing lists by exploring webpages that
meet your criteria. Rover can utilize web page indexes,
search engines and other popular Internet site indexes as
starting points, allowing you to pinpoint just the companies
and individuals you want to reach with your message.

Great! Just what we needed, a spider/search engine for junk mailing. Of
course, it's a pay service. I guess they don't want to stick to usenet
post culling any more.

- dws

10 Megs/sec World Wide Web Hosting - Intercom Online http://www.intercom.com
web hosting, dedicated servers, co-location, ISDN, T-1
Wall Street Web Farm - http://www.intercom.com/webfarm.htm
Have your own dedicated server on our ethernet get hit at 10 Megs a second!