Re: Who sets standards (was Server name in /robots.txt)
Tim Bray (tbray@opentext.com)
Sat, 20 Jan 96 20:07 PST
>Not to be too parochial, but I think it's at least as important to get
>buy-in from companies who are shipping commercial spiders, since there are
>a lot more copies of them out there than there are of the services. A
>standard endorsed by the services doesn't matter to someone who's indexing
>his or her intranet.
Reasonable point. It's just that the big-league index vendors at the
moment have the mind-share and the visibility to get the world's attention
on this issue. I wouldn't care where a standard came from myself.
Cheers, Tim Bray, Open Text Corporation (tbray@opentext.com)