Re: stingy yahoo server?

Klaus Johannes Rusch (e8726057@student.tuwien.ac.at)
Sat, 7 Dec 1996 15:06:09 CET


In <199612070136.AA082662607@hposl41.cup.hp.com>, Mark Norman <mnorman@hposl41.cup.hp.com> writes:
> I tried to retrieve this URL from yahoo, but it gave me error 302
> (moved temporarily). When I use netscape, it retrieves it. Is yahoo's
> server denying access based on user-agent or some other header info?
> Also, what should be in the request header from a robot? thanks all.

Not at all, the result of your GET request is a 302 moved temporarily, which
means your client (browser, robot, you if you are telnetting to port 80
directly) should issue a request for the document at the new location, found in
the location header.

If you carefully watch your browser access the URL, you will see it connects
twice, once to the host you tried (www.yahoo.com), and once to the redirected
location.

Nothing browser specific here.

Klaus Johannes Rusch

--
e8726057@student.tuwien.ac.at, KlausRusch@atmedia.net
http://www.atmedia.net/KlausRusch/
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html