The Web Robots Pages

Magpie

Name Magpie
Cover Page
Details Page
Operational Status development
Description Used to obtain information from a specified list of web pages for local indexing. Runs every two hours, and visits only a small number of sites.
Robot Purpose indexing, statistics
Software Type standalone
Software Platform unix
Software Language perl5
Availability
Owner's Name Keith Jones
Owner's Home Page
Owner's Email Address Keith.Jones@blueberry.co.uk
Exclusion Protocol no
Exclusion Tag
Supports NOINDEX no
Robot Host *.blueberry.co.uk, 194.70.52.*, 193.131.167.144
HTTP From no
HTTP User-Agent Magpie/1.0
History Part of a research project. Alpha testing from 10 July 1996, Beta testing from 10 September.
Environment research
Identifier magpie
Updated Wed, 10 Oct 1996 13:15:00 GMT
Update By Keith Jones

The Web Robots Database