Content based robot collectors

Scott 'Webster' Wood (swood@thewild.com)
Tue, 4 Jun 1996 16:04:55 -0400 (EDT)


Can anyone point me to samples of robots that could be used to collect
WWW data based on content? (ie matching keywords) Before pulling out
my programming books, I would be curious to know if there are any existing
code or program samples.

I need to seek out pages with specific interest areas and navigate links off
of them for other similar pages. If the pages do not include the information
I am seeking, then I do not want to pursue further links in that direction...

Scott