The Web Robots Pages

ht://Dig

Name ht://Dig
Cover Page http://www.htdig.org/
Details Page http://www.htdig.org/howitworks.html
Operational Status
Robot Purpose indexing
Software Type standalone
Software Platform unix
Software Language C,C++.
Availability source
Owner's Name Andrew Scherpbier
Owner's Home Page http://www.htdig.org/author.html
Owner's Email Address andrew@contigo.com
Exclusion Protocol yes
Exclusion Tag htdig
Supports NOINDEX yes
Robot Host *
HTTP From no
HTTP User-Agent htdig/3.1.0b2
History This robot was originally developed for use at San Diego State University.
Environment
Identifier htdig
Updated Tue, 3 Nov 1998 10:09:02 EST
Update By Geoff Hutchison

The Web Robots Database