> If a human is controlling an application it's not a robot,
Here's a definition that's OK by me. Since ActiveAgent
is controlled by a human (the documentation uses the word
"driven"), it should never access the ROBOTS.TXT file and
will never need to obey the robots-exclusion "standard".
Thanks for the lively discussion.
... Robert
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html