Re: Lycos

Klaus Johannes Rusch (e8726057@student.tuwien.ac.at)
Tue, 7 Jan 1997 19:56:09 CET


In <3.0.32.19970107172123.007090c0@gatekeeper.grolier.fr>, Thomas Merlin <tom@grolier.fr> writes:
> I appreciate your help about this http://www.rfi.fr question but what I
> meant is, I directly submitted the URL to Lycos, HotBot, etc and nothing
> came up. One of you told me some robots don't like sites fond of
> cookies...hmmm...I'll have to think about that !

Most robots take a while before documents actually show up - varyies between a
few hours to several weeks before the document actually is found in searches,
even though the robot may have visited the document immediately.

Klaus Johannes Rusch

--
e8726057@student.tuwien.ac.at, KlausRusch@atmedia.net
http://www.atmedia.net/KlausRusch/
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html