Re: Robot-HTML Web Page?

Paul Francis (francis@cactus.slab.ntt.jp)
Fri, 24 May 96 11:20:54 JST


>
> I'm looking for a DEFINITIVE guide that completely explains how robots
> "read" HTML pages so that I can incorporate appropriate HTML codes to
> instruct the spider to submit appropriate summaries, keywords, etc. to
> various search engines that are based on spiders. (META?)
>
> Please reply through e-mail. I'm not subscribed to this list.
>

Though I would also be interested in this, I don't think
that such a thing exists. In fact, I believe that the purpose
of a workshop organized by Mike Schwartz and being held next
week in Boston is to (among other things) look into appropriate
standards/conventions for just this kind of functionality.

In any event, could people please respond to the whole list
as well as J.Y.K? I think this is of general interest.

PF