John
At 03:25 PM 2/13/97 -0500, you wrote:
>
>I'm finding that a lot of servers don't support 'If-Modified-Since'
>conditional GET's, even ones such as Netscape.com and Microsoft.com. The
>application that I'm writing will be re-checking selected URLs every few
>weeks for updates, so in the interest of preserving bandwidth, I'd like this
>to work.
>
>Using LWP (for perl), I use the following line to ask remote servers for any
>documents that are less then half a day old:
>$request->header('If-Modified-Since' => HTTP::Date::time2str(time-40000));
>
>
>Many responses come back '304', but about one third of them are *still*
>'200'. NCSA, Netscape and Apache servers all seem to be guilty and
>not-guilty of this, depending on whose site you visit.
>
>Is there something I'm doing wrong?
>
>
>Dan Howard
>Industry Canada
>(613) 596-0201
>
>_________________________________________________
>This messages was sent by the robots mailing list. To unsubscribe, send mail
>to robots-request@webcrawler.com with the word "unsubscribe" in the body.
>For more info see http://info.webcrawler.com/mak/projects/robots/robots.html
>
>
---------------------------------------------------------------
John James Email: jjames@firstfloor.COM
First Floor, Inc. Web: http://www.firstfloor.COM
444 Castro Street, Suite 200 Tel: (415) 254-5101
Mountain View. CA 94041 Fax: (415) 968-1193
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html