Re: Preferred access time
John D. Pritchard (jdp@cs.columbia.edu)
Mon, 23 Sep 1996 17:43:55 -0400
> Sorry if this question is moronic, however, i can't seem to find
> anywhere a definitive spec for where to find the preferred access times
> for servers, and a concrete value for backoff times for bots and
> crawlers. Is this because there is no concrete spec for them? Thanks a
> billion.
>
> M/
how would one want to handle this?
AccessFromToGMT HHMM HHMM
in "/robots.txt"?
or HTTP Error Code?
XXX Server too busy for non humans
-john