Re: in-document directive to discourage indexing ?
Kevin Hoogheem (khooghee@marys.smumn.edu)
Tue, 25 Jun 96 09:25:38 -0500
Well ya notice I didnt say it was a mandatory thing each robot
should have to do, I was merly suggesting it for some robots
might want to do or probly would come down to a robot that
was just ment for this type of activty. Oh well it was just a though.
Also a serious breach of netiquette, comeon-- I would say it is more
of a breach to write a crapy robot that bombs someons sites
trying to collect data that was poorly written or writing an
OS like windoze ;)-
also like i said in a previous letter, It is up to the admin
to have a site that works properly, If I am a customer a paying
or nonpaying customer and visit IBM's website I want links that work
not ones that were broken when moving although I should understand
at 3am in the morn people dont and then think your service is always
like this.
What is the differance between 1000 people mailing you saying your site
is broken then an effecient robot doing it.
WHY WERE robots made to index couldnt a human do it? was this a serious breach of netiquette?
KH