| Name | Monster |
|---|---|
| Cover Page | http://www.neva.ru/monster.list/russian.www.html |
| Details Page | |
| Operational Status | active |
| Description | The Monster has two parts - Web searcher and Web analyzer. Searcher is intended to perform the list of WWW sites of desired domain (for example it can perform list of all WWW sites of mit.edu, com, org, etc... domain) In the User-agent field $TYPE is set to 'Mapper' for Web searcher and 'StAlone' for Web analyzer. |
| Robot Purpose | maintenance, mirroring |
| Software Type | standalone |
| Software Platform | UNIX (Linux) |
| Software Language | C |
| Availability | binary |
| Owner's Name | Dmitry Dicky |
| Owner's Home Page | http://wild.stu.neva.ru/ |
| Owner's Email Address | diwil@wild.stu.neva.ru |
| Exclusion Protocol | yes |
| Exclusion Tag | |
| Supports NOINDEX | no |
| Robot Host | wild.stu.neva.ru |
| HTTP From | |
| HTTP User-Agent | Monster/vX.X.X -$TYPE ($OSTYPE) |
| History | Now the full (I suppose) list of ex-USSR sites is produced. |
| Environment | |
| Identifier | monster |
| Updated | Tue Jun 25 10:03:36 1996 |
| Update By |
The Web Robots Database