Re: Unfriendly robot at 205.177.10.2

Reinier Post (reinpost@win.tue.nl)
Thu, 19 Oct 1995 15:53:11 +0100 (MET)

>The correct address of the owner of the robot is 205.252.60.50, which won't
>resolve. Tight security, apparently. Ironically.

Well, on our site (www.win.tue.nl), it's causing no problems at all:

% grep '205\.252' /usr/www/logs/cern_access.log
205.252.60.50 - - [13/Oct/1995:12:30:13 +0100] "GET / HTTP/1.0" 302 381
205.252.60.50 - - [13/Oct/1995:20:58:55 +0100] "GET / HTTP/1.0" 302 381
% wc /usr/www/logs/cern_access.log
206422 2062250 22193056 /usr/www/logs/cern_access.log

That is, out of the last 206,422 requests, 2 were from this site.

Lycos wants to index as many documents on a site it can find. This
robot has only made two requests, and it didn't even retrieve our home page
(/ is redirected to /win/, which is the actual home page). Perhaps it doesn't
follow redirections.

>Nick

-- 
Reinier Post						 reinpost@win.tue.nl
a.k.a. <A HREF="http://www.win.tue.nl/win/cs/is/reinpost/">me</A>
[LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK]