Re: Suggestion to help robots and sites coexist a little better

Rob Hartill (robh@imdb.com)
Mon, 15 Jul 1996 15:22:57 -0500 (CDT)

Messages sorted by: [ date ][ thread ][ subject ][ author ]
Next message: Chris Crowther: "Re: interactive generation of URL's"
Previous message: Randy Terbush: "Re: Suggestion to help robots and sites coexist a little better"
In reply to: Skip Montanaro: "Suggestion to help robots and sites coexist a little better"
Next in thread: Nick Arnett: "Re: Suggestion to help robots and sites coexist a little better"

Whether we introduce a new header (Robot) or add to User-Agent, I don't
mind. The reason I suggested a new header was so that it avoided any
interaction with existing User-Agent identifiers... someone has probably
already added word "robot" to their browser's user agent identifier.
On the other hand, there's already a lot of support (for logging etc)
for user agent, so one might as well take advantage of that.

Next message: Chris Crowther: "Re: interactive generation of URL's"
Previous message: Randy Terbush: "Re: Suggestion to help robots and sites coexist a little better"
In reply to: Skip Montanaro: "Suggestion to help robots and sites coexist a little better"
Next in thread: Nick Arnett: "Re: Suggestion to help robots and sites coexist a little better"