OH ya lets blame the public and say oh THEY cant have webcrawlers
they wont know how to run them or work them, Gee IF the builders
of the webcrawlers build them correctly to make it so there are little
problems that can occur with said webcrawlers there will not be such
a big problem as you perceive. Lets ask this what is the implications
of every company out there having a webcrawler for there search engine
that couldnt find its way out of a paper bag? I think there should
be more work done in both areas both in a better search engine that
can break down better requests for people and in better robots that
are not out there doing stupid things like fetching the same document
over and over because they did not test it thuraly on a closed site
first. It does not take a rocket scientist to make a robot, but it
do take time to make a good one.
lets not look at what will happen when everyone will have one that
is the same question people ask about every product, what will happen
when everyone can own a car, oh no, the railroads will go out
of business, what will happen when someone makes the first
personal computer, oh no mainframes become obsolete.
Kevin Hoogheem