Search Engine Tutorial for Web Developers
Edward Stangler (mred@neosoft.com)
Thu, 8 Aug 1996 22:32:26 CDT
This page has some interesting information on the major search engines,
spiders and crawlers, and the robot exclusion standard:
http://www.digital-cafe.com/~webmaster/nw01_05.htm
-Ed-
mred@neosoft.com
http://www.neosoft.com/~mred/