| Name | HTMLgobble |
|---|---|
| Cover Page | |
| Details Page | |
| Operational Status | |
| Description | A mirroring robot. Configured to stay within a directory, sleeps between requests, and the next version will use HEAD to check if the entire document needs to be retrieved |
| Robot Purpose | mirror |
| Software Type | |
| Software Platform | |
| Software Language | |
| Availability | |
| Owner's Name | Andreas Ley |
| Owner's Home Page | |
| Owner's Email Address | ley@rz.uni-karlsruhe.de |
| Exclusion Protocol | |
| Exclusion Tag | |
| Supports NOINDEX | no |
| Robot Host | tp70.rz.uni-karlsruhe.de |
| HTTP From | yes |
| HTTP User-Agent | HTMLgobble v2.2 |
| History | |
| Environment | |
| Identifier | htmlgobble |
| Updated | |
| Update By |
The Web Robots Database