> My problem is deciding exactly *which* words are important to index, and
> how to store such a huge amount of data in a manner that will be easily
> accessible for a search engine.
<laugh> The problem of categorizing knowledge has been with us
for a very long time and I believe, will continue to plague us
for a great time to come. This is what we computer scientists
call a "hard" problem.
Perhaps you might consider pursuing a degree in Library Science?
-- </rr> Rob Raisch, The Internet Company