> maybe it's me, but creating a standard designed to have robots suck up
> less bandwidth / server time by having them send lots of messages back
> and forth seems counter-productive... :)
saving bandwidth with smaller messages is a bad thing?
anyhow, there would be messages asking for /robots.txt as there are now.
within the request headers would be a new one.
if anything this should reduce email to robots about nasty robots because
complaints could instead be submitted as statistical info on a robot in a
statistical robot class list.
the list would be moderated to prevent people from bashing on someone
else's robot.
-john
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html