About 40 hours ago I received the following hits on http://:
www.roverbot.com [25/Jun/1996:20:45:02 /robots.txt - "Roverbot "
www.roverbot.com [25/Jun/1996:20:45:03 /isdn/isdnfaq3.htm - "Roverbot "
www.roverbot.com [25/Jun/1996:20:49:52 /robots.txt - "Roverbot "
www.roverbot.com [25/Jun/1996:20:49:53 /isdn/isdnfaq1.htm - "Roverbot "
Curiously I decided to check out that web page...This is how I am greeted:
Welcome to Rover
Rover is a unique Internet research tool that generates
custom email mailing lists by exploring webpages that
meet your criteria. Rover can utilize web page indexes,
search engines and other popular Internet site indexes as
starting points, allowing you to pinpoint just the companies
and individuals you want to reach with your message.
Great! Just what we needed, a spider/search engine for junk mailing. Of
course, it's a pay service. I guess they don't want to stick to usenet
post culling any more.
- dws
10 Megs/sec World Wide Web Hosting - Intercom Online http://www.intercom.com
web hosting, dedicated servers, co-location, ISDN, T-1
Wall Street Web Farm - http://www.intercom.com/webfarm.htm
Have your own dedicated server on our ethernet get hit at 10 Megs a second!