Just when you thought it might be interesting to standardize
Dave Bakin (dbakin@intrinsa.com)
Wed, 04 Dec 1996 11:58:29 -0800
Haven't heard this discussed yet, but check out
http://www.packet.com/packet/96/49/index2a.html for a discussion of a
proposed "sitelist.txt" from InfoSeek. -- Dave
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html