heh, I got the successful page, but I monitored the logs, and nothing
from Lycos came in, not even once.
> Keep in mind that while the page may instantly be spidered, the page
> is NOT instantly added to the catalog. No one does this, although
> Alta Vista and Infoseek are the best. They will instantly spider a
> page and usually have it in the catalog in about two days.
I know, spidering != indexing :)
I didn't expect it to be in the catalogue right away, but I expected to see at
least one HEAD or GET from Lycos.
> Finally, remember that just because a page is instantly spidered, the
> site itself is not instantly crawled. That comes later, sometimes
> much later.
yes, I understand that, but not even one(1) page was instantly 'spidered'
(what kind of word is this anyway ?)
> "A Webmaster's Guide to Search Engines"
> http://calafia.com/webmasters/
interesting site ^^^
So, what's the answer ? None yet, right ? Lycos people are full of it or did
I just have a very bad luck 3-4 times in a row ?
Otis
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html