..., and I found the:
FuckYouCypherWimps = "robots.txt";
line a bit disturbing. ...
(the variable name is most probably directed at the "tech-skilled netizen",
as mentioned in ActiveAgent.info)
It is. ActiveAgent explicitelly avoids to read that file. Robert has
commented this:
It is my opinion that the Internet (and computer advance
in general) has done more to undermine personal freedom than anything
the police-states do.
I honestly think HipCrime should be commended
for creating a novel new spider,
"commended"? For producing a spammers tool, however slow it may be?
No way. If at least it read and processed robots.txt correctly, I
wouldn't complain that much...
-- R Levitte, Levitte Programming; Spannvägen 38, I; S-161 43 Bromma; SWEDEN Tel: +46-8-26 52 47; No fax right now PGP key fingerprint = A6 96 C0 34 3A 96 AA 6C B0 D5 9A DF D2 E9 9C 65 Check http://www.lp.se/~levitte for my public key. bastard@bofh.se