RE: nastygram from xxx.lanl.gov

Tim Bray (tbray@opentext.com)
Wed, 10 Jul 1996 10:56:37 -0700


Can we end this?

The facts are: xxx.lanl.gov has a reasonable and correct REP file.

People should respect it when doing any signficant non-manual retrievals.

The methods they have adopted to punish offenders are controversial, but
not really worth discussing here.

They have made one SERIOUS TECHNICAL ERROR in making the /robots.txt
un-retrievable to anyone they consider an enemy, thus anyone who makes
one mistake had better hard-wire a xxx.lanl.gov avoidance into their
robot to avoid continuing wars.

So, enough already. -Tim