> Of course, if all your sources are search-engines generated by robots
> that do /robots.txt, you should never get a link that violates it >:-))
Erik wrote:
>You'd think that were true, wouldn't you? Seems folks on the
>list don't agree for some silly reason... :)
At 4:59 PM 11/25/96, Brian Clark wrote:
>Well, I'd be one of those people that doesn't agree.
Sheesh, doesn't anyone read smiley's anymore?
-- Martijn
Email: m.koster@webcrawler.com
WWW: http://info.webcrawler.com/mak/mak.html
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html