Re: Looking for a spider

Alvaro Monge (amonge@cs.ucsd.edu)
Wed, 18 Oct 1995 15:00:01 -0700 (PDT)


Unfortunately, I cannot use most robots that I know of because they
DO NOT SAVE the entire document, or its hierarchical structure.

Lycos for example:

> The Lycos exploration robot locates new and changed documents and
> builds abstracts, which consist of title, headings, subheadings,
> 100 most significant words and the first 20 lines of the document.

For my research, this is not that useful. I need the entire document,
as it appears at the source -- not as saved by some robot, because I
want to follow the links within the document.

--Alvaro