Re: who/what uses robots.txt

Hrvoje Niksic (hniksic@srce.hr)
22 Nov 1996 06:18:43 +0100

(HipCrime@hipcrime.com) wrote:
> Hrvoje Niksic <hniksic@srce.hr> wrote:
>
> > The people on this list should take care not to put too many
> > things to robots.txt, because it will make authors of such
> > utilities skeptical whether they should implement the support
> > at all ("_my_ utility is _not_ a robot").
>
> Definitions are _not_ "too many things". Failing to be able
> to agree on the meaning of the word "robot" is to admit that
> you can't define a "robot" standard. Period.

You misunderstand. I meant that the robots.txt standard should not be
overloaded lest robot agents get scared, and don't support it at all.
I didn't imply that the standard should not define what the word
"robot" means.

-- 
Hrvoje Niksic <hniksic@srce.hr> | Hocemo 101-icu!
--------------------------------+--------------------------------
`VI' - An editor used by those heretics that don't subscribe to
       the Emacs religion.
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html