Name | Magpie |
---|---|
Cover Page | |
Details Page | |
Operational Status | development |
Description | Used to obtain information from a specified list of web pages for local indexing. Runs every two hours, and visits only a small number of sites. |
Robot Purpose | indexing, statistics |
Software Type | standalone |
Software Platform | unix |
Software Language | perl5 |
Availability | |
Owner's Name | Keith Jones |
Owner's Home Page | |
Owner's Email Address | Keith.Jones@blueberry.co.uk |
Exclusion Protocol | no |
Exclusion Tag | |
Supports NOINDEX | no |
Robot Host | *.blueberry.co.uk, 194.70.52.*, 193.131.167.144 |
HTTP From | no |
HTTP User-Agent | Magpie/1.0 |
History | Part of a research project. Alpha testing from 10 July 1996, Beta testing from 10 September. |
Environment | research |
Identifier | magpie |
Updated | Wed, 10 Oct 1996 13:15:00 GMT |
Update By | Keith Jones |
The Web Robots Database