| Name | UCSD Crawl |
|---|---|
| Cover Page | http://www.mib.org/~ucsdcrawl |
| Details Page | |
| Operational Status | |
| Description | Should hit ONLY within UC San Diego - trying to count servers here. |
| Robot Purpose | indexing, statistics |
| Software Type | standalone |
| Software Platform | |
| Software Language | Perl 4 |
| Availability | |
| Owner's Name | Adam Tilghman |
| Owner's Home Page | http://www.mib.org/~atilghma |
| Owner's Email Address | atilghma@mib.org |
| Exclusion Protocol | yes |
| Exclusion Tag | |
| Supports NOINDEX | |
| Robot Host | nuthaus.mib.org scilib.ucsd.edu |
| HTTP From | yes |
| HTTP User-Agent | UCSD-Crawler |
| History | |
| Environment | |
| Identifier | ucsd |
| Updated | Sat Jan 27 09:21:40 1996. |
| Update By |
The Web Robots Database