got a question - I just tried Lycos' 'Real Time spidering'.
So I submitted a page and monitored the logs.
Guess what ?
The spider never showed up :)
Does anyone know what's up with that 'real spidering' ?
Is it just temporarily not working, or do they have it there for
people to get impressed ?
Thanks,
Otis
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html