Possible robots.txt addition - did I say that?

Martin Kiff (mgk@webfeet.co.uk)
Wed, 6 Nov 1996 21:25:30 +0100


I seem to have said...

> The next step I did was run a CGI script on the old machine which
> reported a 302 to any known robots and a redirect to others.

... of course it was a '404' to known robots and a redirect to anything
else. Problem was that the redirect (a 'Location:') seemed to give a 302
which the search engines took as a temporary move of the page rather
than a permanent one...

Regards,
Martin Kiff
mgk@webfeet.co.uk