Re: defining "robot"

Erik Selberg (selberg@cs.washington.edu)
25 Nov 1996 12:02:23 -0800


m.koster@webcrawler.com (Martijn Koster) writes:

> Of course, if all your sources are search-engines generated by robots
> that do /robots.txt, you should never get a link that violates it :-))

You'd think that were true, wouldn't you? Seems folks on the list
don't agree for some silly reason... :)

-- 
				Erik Selberg
"I get by with a little help	selberg@cs.washington.edu
 from my friends."		http://www.cs.washington.edu/homes/selberg
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html