Web Robot

Matthew Gray (mkgray@Netgen.COM)
Sat, 6 Jan 1996 09:36:04 -0500 (EST)


Last night we were hit a few hundred times (spaced over many hours) by a
robot calling itself 'Web Robot/OTWR:001p116 libwww/2.17' coming from
205.216.146.163. It did not request /robots.txt but was otherwise
perfectly reasonable. This one is not on the list of known robots.

On a related note, I've been running a number of robots,
with User-Agent's as follows:

webTool
Wander
Mk1

Matthew Gray ---------------------------- voice: (617) 577-9800 x240
net.Genesis fax: (617) 577-9850
68 Rogers St. mkgray@netgen.com
Cambridge, MA 02142-1119 ------------- http://www.netgen.com/~mkgray