Name | the World Wide Web Wanderer |
---|---|
Cover Page | http://www.mit.edu/people/mkgray/net/ |
Details Page | |
Operational Status | active |
Description | Run initially in June 1993, its aim is to measure the growth in the web. |
Robot Purpose | statistics |
Software Type | standalone |
Software Platform | unix |
Software Language | perl4 |
Availability | data |
Owner's Name | Matthew Gray |
Owner's Home Page | http://www.mit.edu:8001/people/mkgray/mkgray.html |
Owner's Email Address | mkgray@mit.edu |
Exclusion Protocol | no |
Exclusion Tag | |
Supports NOINDEX | no |
Robot Host | *.mit.edu |
HTTP From | |
HTTP User-Agent | WWWWanderer v3.0 |
History | |
Environment | research |
Identifier | wanderer |
Updated | |
Update By |
The Web Robots Database