Re: nastygram from xxx.lanl.gov

Rob Hartill (robh@imdb.com)
Tue, 9 Jul 1996 21:42:44 -0600 (MDT)


Okay, I've read a lot of crap in this thread about the reaction
of the xxx.lanl.gov admin to the clown who sent a pile of HEAD
requests to that site and ignoring the robots.txt file there.

Some of the URLs this clown accessed started long CPU intensive
processes that involved multiple machines in xxx's e-print archive
system. There are limited resources for this system and they were
being wasted by this clown's irresponsible actions. This has a knock on
effect that people using the service properly are presented with
"system overload" messages, and their research comes to a screaching halt.

If you don't want to be mailbombed - respect robots.txt
If you don't want to be sued - respect robots.txt
If you don't want to be billed for damages - respect robots.txt

rob