Re: Preliminary robot.faq (Please Send Questions or Comments)
Tim Bray (tbray@opentext.com)
Tue, 7 Nov 95 07:11 PST
>1.1) What is a ROBOT?
>
> A Robot is a program that traverses the World Wide Web, gathering some
>sort of information from each site it visits. This journey is accomplished
>by visiting a web page and then recursively visiting all or some of it's
>linked pages.
True but misleading; there are much better strategies for covering
the web than this kind of direct recursion.
Cheers, Tim Bray, Open Text Corporation (tbray@opentext.com)