The Web Robots Pages

GetURL

Name GetURL
Cover Page http://Snark.apana.org.au/James/GetURL/
Details Page
Operational Status
Description Its purpose is to validate links, perform mirroring, and copy document trees. Designed as a tool for retrieving web pages in batch mode without the encumbrance of a browser. Can be used to describe a set of pages to fetch, and to maintain an archive or mirror. Is not run by a central site and accessed by clients - is run by the end user or archive maintainer
Robot Purpose maintenance, mirroring
Software Type standalone
Software Platform
Software Language ARexx (Amiga REXX)
Availability
Owner's Name James Burton
Owner's Home Page http://Snark.apana.org.au/James/
Owner's Email Address James@Snark.apana.org.au
Exclusion Protocol no
Exclusion Tag
Supports NOINDEX no
Robot Host *
HTTP From no
HTTP User-Agent GetURL.rexx v1.05
History
Environment
Identifier geturl
Updated Tue May 9 15:13:12 1995
Update By

The Web Robots Database