Name | Freecrawl |
---|---|
Cover Page | http://euroseek.net/ |
Operational Status | active |
Description | The Freecrawl robot is used to build a database for the EuroSeek service. |
Robot Purpose | indexing |
Software Type | standalone |
Software Platform | unix |
Software Language | c |
Availability | none |
Owner's Name | Jesper Ekhall |
Owner's Email Address | ekhall@freeside.net |
Exclusion Protocol | yes |
Exclusion Tag | Freecrawl |
Supports NOINDEX | no |
Robot Host | *.freeside.net |
HTTP From | yes |
HTTP User-Agent | Freecrawl |
Environment | service |
Identifier | freecrawl |
The Web Robots Database