Alta Vista searches WHAT?!?

Ed Carp @ TSSUN5 (ecarp@tssun5.dsccc.com)
Tue, 16 Jan 1996 13:05:36 -0600


There has been a concern raised on another list that I belong to, about the
privacy implications of robots and such. The specific example was that the
Alta Vista web crawler didn't only index linked documents, but any and all
documents that it could find at a site! Is this true, and if so, how is it
doing it? How does one keep documents private? I sure don't want my personal
correspondence sitting out on someone's database just because my home directory
happens to be readable!