Topic-specific robots

Fred K. Lenherr (lenherr@tiac.net)
Wed, 09 Oct 1996 08:54:59 -0400

A while ago, I inquired if there were any "topic-specific" robots --
robots that would qualify each page they see for relevance to
a given topic (baseball, ming dynasty, whatever), and only retrieve
the relevant ones for indexing.

I don't recall many replies. I have now created one of my own,
and set up the search site. It found about 55,000 docs containing
some 200 MB text on my topic.

So I'd like to ask again if anyone knows of other such sites.
Reply here or by email as you prefer.

In particular, does Harvest allow this? Are there any such sites?

I'm holding off on announcing my site publicly while I gather user
statistics. It's not of general interest anyhow.

But I'd like to get in touch with others doing this sort of thing
to exchange research ideas.

Thanks,

Fred K. Lenherr
lenherr@tiac.net