Re: make people use ROBOTS.txt?

Richard Levitte - VMS Whacker (levitte@lp.se)
Sat, 23 Nov 1996 12:19:37 MET


Let's take HipCrime's ActiveAgent as an example.

Q: What is its goal?
A: To locate as many Email addresses as possible.

Hmm, that's just part of it, isn't it?

Would it be correct for ActiveAgent's author to implement
something that would inhibit completion of this assignment?

It *would* be very correct for it to behave. It's just like in
Real Life, you have to be civilized...

Programmers, be truthful to yourselves: didn't you learn
(early on), that efficiency is tantamount to success?

How about correctness?

We're talking about the WORLD wide web here. Who on this list
(really) believes that he/she can define the motives of "the world"?

Well, I'd say we have quite a huge list of RFC's that are pretty
much followed by the whole world (uh, let's define "the world" as
"Internet", shall we?), in one way or another. In the end, the key
word here is interoperability, and a certain amount of politeness.

-- 
R Levitte, Levitte Programming; Spannvägen 38, I; S-161 43  Bromma; SWEDEN
                  Tel: +46-8-26 52 47;  No fax right now
  PGP key fingerprint = A6 96 C0 34 3A 96 AA 6C  B0 D5 9A DF D2 E9 9C 65
   Check http://www.lp.se/~levitte for my public key.   bastard@bofh.se
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html