>
> that doesn't tell me how widely used robots.txt is out there, only
> what's accessing my site.
>
ok, sorry....
I doubt anyone out there has a definite answer to your question, but it
would certainly be interesting to do ......why don't you give it a shot
yourself? Create a robot that traverses the Web, it would only asks for
'robots.txt', if it is there increase your counter.... :-)
Regards,
Qusay H. Mahmoud
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html