>Unfortunately, I cannot use most robots that I know of because they
>DO NOT SAVE the entire document, or its hierarchical structure.
>
>Lycos for example:
>
>> The Lycos exploration robot locates new and changed documents and
>> builds abstracts, which consist of title, headings, subheadings,
>> 100 most significant words and the first 20 lines of the document.
>
>For my research, this is not that useful. I need the entire document,
>as it appears at the source -- not as saved by some robot, because I
>want to follow the links within the document.
Lycos follows the links of documents; that's how robots work.
The summaries are built for indexing purposes. You can't save
the full text of all documents because of the disk space requirements
(perhaps OpenText can?) and because of legal considerations.
>--Alvaro
-- Reinier Post reinpost@win.tue.nl a.k.a. <A HREF="http://www.win.tue.nl/win/cs/is/reinpost/">me</A> [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK] [LINK]