I checked out http://xxx.lanl.gov, and the guy(s) aren't just unfriendly
to robots... they claim at least that they'll "attack" your site if you
do any number of things they don't like.
The folks at the Los Alamos Nat'l Labs seem to have a psychotic fool
running their archives. If not psychotic, certainly sociopathic. I
can't believe our tax dollars go to support idiots with pages like this
one: http://xxx.lanl.gov/legal/ [note: it's a lame page]
At least the guy links back to info on the robot.txt file
recommendations, at the very least. I don't understand their hyperbole
or their caustic posturing against agents, etc. Also, I couldn't find
any information on who authorized this guy to put junk like that on a
.gov site. I certainly have a problem with government sites threatening
retaliation if you happen to send one too many GET requests their way.
-- Rob Turk <mailto:rturk@austin.ibm.com> Unofficially Speaking. Artistic ventures highlighted. Rob a museum.