>
> What would appear to be a robot just came through my site. To say
> it does not adhere to the Standards for Robot Exclusion is an
> understatement. Picked up files that are expressly forbade in
> /robots.txt - actually never picked up robots.txt. In a 7 minute
> period picked up 88 files. No User-Agent to identify it. All I have
> is this:
>
> 194.97.0.55
>
> As I write this, I find I'm not surprised at the 'antisocial'
> reactions of some Webmasters out there. If mine were not a
> commercial site, I'd be screaming alot more loudly at anyone who
> writes/runs robots such as I've just experienced.
>
> Anyone have any idea who or what this is?
I couldn't find anything in the DNS records, but a traceroute gave this:
16 DE-CIX.topnet.de (194.31.232.49) 472.005 ms 265.589 ms 337.337 ms
17 Frankfurt.TopNet.DE (194.97.110.185) 351.676 ms 334.084 ms 375.078 ms
18 Krefeld.TopNet.DE (194.97.110.181) 370.48 ms 372.375 ms 344.211 ms
19 Koeln2.TopNet.DE (194.97.110.178) 1064.62 ms 406.208 ms 274.069 ms
20 194.97.0.55 (194.97.0.55) 401.379 ms 436.404 ms 523.957 ms
I would start by talking to root@topnet.de or postmaster@topnet.de.
-- Benjamin Franz