| Name | webs |
|---|---|
| Cover Page | http://webdew.rnet.or.jp/ |
| Details Page | http://webdew.rnet.or.jp/service/shank/NAVI/SEARCH/info2.html#robot |
| Operational Status | active |
| Description | The webs robot is used to gather WWW servers' top pages last modified date data. Collected statistics reflects the priority of WWW server data collection for webdew indexing service. Indexing in webdew is done by manually. |
| Robot Purpose | statistics |
| Software Type | standalone |
| Software Platform | unix |
| Software Language | perl5 |
| Availability | none |
| Owner's Name | Recruit Co.Ltd, |
| Owner's Home Page | |
| Owner's Email Address | dew@wwwadmin.rnet.or.jp |
| Exclusion Protocol | yes |
| Exclusion Tag | webs |
| Supports NOINDEX | no |
| Robot Host | lemon.recruit.co.jp |
| HTTP From | yes |
| HTTP User-Agent | webs@recruit.co.jp |
| History | |
| Environment | service |
| Identifier | webs |
| Updated | Fri, 6 Sep 1996 10:00:00 GMT |
| Update By |
The Web Robots Database