Good HREFs vs Bogus HREFs: 80/20

mike mulligan (mulligan@northernlight.com)
Thu, 26 Dec 1996 13:05:11 -0500


As an aspiring robot developer getting some results back, and I wanted to
compare my numbers against what others are seeing. On general web crawling,
when I chase down HREFs, I am seeing about 80% success (200) and about 20%
failure (404). Is this in the proper ballpark, or should I suspect some
systematic bug lurking in my code?

thanks
- mike mulligan

_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html