Re: Should I index all ...

Chris Crowther (chris@jm-crowther.co.uk)
Tue, 9 Jul 1996 14:00:18 +0000


Hi,

> Unfortunately, it also prevents users from finding "The United States of
> America" and similar phrases, which tends to confuse people quite a bit.
> Stop words can be stripped from the query if necessary to avoid the problem
> you describe. Our engine does so as a matter of routine when you use our
> free text parser, for example.

British rebuke here: And? :)

Question I've been meaning to ask - could someone tell me where to
find the Guidlines for Robots? I really need the ones that give the
context for robots.txt
Chris,
chris@jm-crowther.co.uk
www.dungeon.com/~jmcrowther/chris.html
ChegHchu djajVam djajKak!