non 2nn repsonses on robots.txt

Aaron Nabil (nabil@teleport.com)
Sun, 13 Oct 1996 20:12:44 -0700 (PDT)

I'd like to propose that any future robot exclusion standards should
require that anything other than a 2nn response to a request for /robot.txt
would be synonymous with an null robots.txt.

This would disallow redirected /robots.txt, which are a bad idea anyway.

-- 
Aaron Nabil
nabil@teleport.com