Welcome to the group :-)
>I am the lead developer on our WebAnalyzer product.
Cool. Can you send a description form for the list of active robots?
>I intend to implement the robot exclusion protocal and anything else
>that comes up.
Excellent. I've been planning for ages to make a C implementation of
a robots.txt parser/comparator available. If that would help, contact
me privately...
Regards,
-- Martijn
Email: m.koster@webcrawler.com
WWW: http://info.webcrawler.com/mak/mak.html