Re: BackRub robot

Ron Kanagy (rkanagy@erols.com)
Thu, 13 Jun 1996 18:29:22 -0400

L a r r y P a g e wrote:
>
> I've fixed the rate problem. I believe it was only happening rarely, which
> is why I didn't notice it sooner.
>
> However, I don't have an easy way to determine if a response is made before
> firing off a new one, except setting the time between hits to be large.
> This is because of the way my robot is distributed. Do people think this
> is reasonable?

I beleive this is reasonable. I use WebCompass from Quarterdeck to do my
searching on the internet and after it does a search on various search
engines, it goes out and attempts to read each site in order to produce
summary information of the site. Between reading each site, it will pause
for a user-definable number of seconds (like 10, 30, 60, or 120). It will
also wait for a response from a site after some user-definable amount of
time.

I hope this helps.

Ron Kanagy
rkanagy@erols.com