Re: in-document directive to discourage indexing ?

Jaakko Hyvatti (Jaakko.Hyvatti@Elma.FI)
Tue, 25 Jun 1996 10:41:27 +0300 (EET DST)


>Why should a Admin-Email entry be mandatory, well I can think of
>one reason and that is Since most people that
>have written robots have the ablity to tell if a link is bad or doesnt
>work anymore with there robot they could easily send a message to the
>administrator of that website with the url and description of the problem
>they have on that page, It would be a way that some Big search engines
>can also give back to the community and also would open up a new
>door for other robots that could better perform checking of websites.

As the others have pointed out, server admin is not usually responsible
for all the documents. Instead, in document headers you should find:

<LINK REV="made" HREF="mailto:x@y.z">

But, it still is a bad idea to generate lots of mail messages
automatically. It could easily look like spamming, and have similar
effects. I have never seen any good use for automatically generating
mail messages to previously unknown human recipients that have not
agreed to receive them.