> The people on this list should take care not to put too many
> things to robots.txt, because it will make authors of such
> utilities skeptical whether they should implement the support
> at all ("_my_ utility is _not_ a robot").
Definitions are _not_ "too many things". Failing to be able
to agree on the meaning of the word "robot" is to admit that
you can't define a "robot" standard. Period.
... Robert
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html