USER_AGENT spoofing

Rob Hartill (robh@imdb.com)
Mon, 16 Dec 1996 05:01:16 +0000 (GMT)

Messages sorted by: [ date ][ thread ][ subject ][ author ]
Next message: Eric Mackie: "Web pages being served from an SQL database"
Previous message: olly@muscat.co.uk: "Re: Crawlers and "dynamic" urls"

Hi all,

Anyone know if NetJet allows USER_AGENT spoofing ?

I've got a "Mozilla/3.0" client all over me at the moment and it has
all the characteristics of a braindead NetJet agent except for the UA.

The UA lacks the usual Netscape waffle describing the system, so it
looks like a spoof.

If anyone's interested, the attack (non-stop rapidfire on robots.txt
protected URLs) is coming from "lf202.ec-lille.fr" (134.206.70.60).

-- 
Rob Hartill.       Internet Movie Database Ltd.    http://www.imdb.com/  
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html

Next message: Eric Mackie: "Web pages being served from an SQL database"
Previous message: olly@muscat.co.uk: "Re: Crawlers and "dynamic" urls"