The Web Robots Pages

URL Check

Name URL Check
Cover Page http://www.cutternet.com/products/webcheck.html
Details Page http://www.cutternet.com/products/urlck.html
Operational Status active
Description The robot is used to manage, maintain, and modify web sites. It builds a database detailing the site, builds HTML reports describing the site, and can be used to up-load pages to the site or to modify existing pages and URLs within the site. It can also be used to mirror whole or partial sites. It supports HTTP, File, FTP, and Mailto schemes.
Robot Purpose maintenance
Software Type standalone
Software Platform unix
Software Language c
Availability binary
Owner's Name Dave Finnegan
Owner's Home Page http://www.cutternet.com
Owner's Email Address dave@cutternet.com
Exclusion Protocol yes
Exclusion Tag urlck
Supports NOINDEX no
Robot Host *
HTTP From yes
HTTP User-Agent urlck/1.2.3
History Originally designed to validate URLs.
Environment commercial
Identifier urlck
Updated July 9, 1997
Update By Dave Finnegan

The Web Robots Database