Re: HEAD

Daniel Lo (daniel@servonet.com)
Thu, 5 Sep 1996 15:40:54 -0700

Messages sorted by: [ date ][ thread ][ subject ][ author ]
Next message: Mike Burner: "The Internet Archive robot"
Previous message: Anna Torti: "HEAD"
Maybe in reply to: Anna Torti: "HEAD"
Next in thread: Captain Napalm: "Re: HEAD"
Reply: Captain Napalm: "Re: HEAD"

> Hello,
>
> what do you think about the "sleep time" between two consecutive HEAD request?
> Which is the least time for not be considered rapid fire?

I prefer that it be adaptive, should it take more than 50 seconds,
or some nice statisical number to retrieve the document, the site is busy,
and it should come back later.

Less than 10 seconds, then maybe after the last document was finished
being retrieved.

- daniel

Next message: Mike Burner: "The Internet Archive robot"
Previous message: Anna Torti: "HEAD"
Maybe in reply to: Anna Torti: "HEAD"
Next in thread: Captain Napalm: "Re: HEAD"
Reply: Captain Napalm: "Re: HEAD"