Sub,
Have you considered Open Text Corporation's Livelink Spider? Our
Spiders have the ability of crawling any data from a network, and
our index engine can handle any type of character encoding.
We currently use the Livelink Spider and Livelink Search (our index
engine) to run the Japanese Open Text Index:
http://www.jp.opentext.com/
To find out more about our Livelink products, please read:
http://www.opentext.com/corp/otm_prod.html
I hope this helps,
gregf.
-- Greg Fenton, Software Engineer http://index.opentext.net/ || Open Text Corporation mailto:gregf@opentext.com || 180 Columbia Street West Phone:(519) 888-7111 x261 || Waterloo, Ontario N2L 3L3 Fax:(519) 888-0677