Being able to distinguish a robot access on individual requests may become
a problem for search engines as users write modules that tailor their
output. An Apache module that tags the dictionary or just the usual porn
words onto the end of every request that comes from a robot is trivial to
write. Many search engines now ignore words in comments for this very
reason (and now you can find many pages that have pages of keywords tagged
to the end with text colors designed to make them not noticable)
Mark
Mark Cox, Technical Director, UK Web ------ http://www.ukweb.com/~mark/