>To me, a single page-watcher is not a robot. Whereas a metacrawler
>that parses search-engine results page, and validates links found
>there (repeatedly), is a robot.
But it is automatic - and should perhaps follow any wishes in a future
'robots.txt' on the rate of hits etc.
Regards,
Martin Kiff
mgk@webfeet.co.uk
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html