Name | PerlCrawler 1.0 |
---|---|
Cover Page | http://perlsearch.hypermart.net/ |
Details Page | http://www.xav.com/scripts/xavatoria/index.html |
Operational Status | active |
Description | The PerlCrawler robot is designed to index and build a database of pages relating to the Perl programming language. |
Robot Purpose | indexing |
Software Type | standalone |
Software Platform | unix |
Software Language | perl5 |
Availability | source |
Owner's Name | Matt McKenzie |
Owner's Home Page | http://perlsearch.hypermart.net/ |
Owner's Email Address | webmaster@perlsearch.hypermart.net |
Exclusion Protocol | yes |
Exclusion Tag | perlcrawler |
Supports NOINDEX | yes |
Robot Host | server5.hypermart.net |
HTTP From | yes |
HTTP User-Agent | PerlCrawler/1.0 Xavatoria/2.0 |
History | Originated in modified form on 25 June 1998 |
Environment | hobby |
Identifier | perlcrawler |
Updated | Fri, 18 Dec 1998 23:37:40 GMT |
Update By | Matt McKenzie |
The Web Robots Database