| Name | Smart Spider |
|---|---|
| Cover Page | http://www.travel-finder.com |
| Details Page | http://www.engsoftware.com/robots.htm |
| Operational Status | active |
| Description | Classifies sites using a Knowledge Base. Robot collects web pages which are then parsed and feed to the Knowledge Base. The Knowledge Base classifies the sites into any of hundreds of categories based on the vocabulary used. Currently used by: //www.travel-finder.com (Travel and Tourist Info) and //www.golightway.com (Christian Sites). Several options exist to control whether sites are discovered and/or classified fully automatically, full manually or somewhere in between. |
| Robot Purpose | indexing |
| Software Type | standalone |
| Software Platform | windows95, windowsNT |
| Software Language | C++ |
| Availability | data, binary, source |
| Owner's Name | Ken Wadland |
| Owner's Home Page | http://www.engsoftware.com |
| Owner's Email Address | ken@engsoftware.com |
| Exclusion Protocol | Yes |
| Exclusion Tag | ESI |
| Supports NOINDEX | Yes |
| Robot Host | 207.16.241.* |
| HTTP From | Yes |
| HTTP User-Agent | ESISmartSpider/2.0 |
| History | Feb '96 -- Product design begun. May '96 -- First data results published by Travel-Finder. Oct '96 -- Generalized and announced and a product for other sites. Jan '97 -- First data results published by GoLightWay. |
| Environment | service, commercial |
| Identifier | smartspider |
| Updated | Mon, 13 Jan 1997 10:41:00 EST |
| Update By | Ken Wadland |
The Web Robots Database