RE: any robots/search-engines which index links?

Louis Monier (monier@pa.dec.com)
Wed, 8 May 1996 07:54:30 -0700

Alex, the longest interval between refreshes of the index was I think 5
weeks, and this was when two overworked guys and few part-time friends
were running the show. Now expect a much better service, with
continuous crawling coming soon. Take a look at the latest index, 30M
pages, many many links.

--Louis

>----------
>From: Alex Chapman[SMTP:alex@budgetweb.com]
>Sent: Saturday, May 04, 1996 10:24 AM
>To: robots@webcrawler.com
>Subject: any robots/search-engines which index links?
>
>I find the feature that AltaVista provides, allowing you to search
>their
>database for pages that link to a specific page very useful. However,
>their database only refreshes about once every two or three months,
>which
>greatly diminishes its usefulness.
>
>Has anyone written a robot which maintains a cross-reference of which
>pages
>link to which other ones? Better yet, are there any search engines
>which
>will allow searches by link other than AltaVista?
>
>The sort of parameter I want to be able to give is
> "+link:budgetweb.com -url:budgetweb.com"
>which would show all pages that have a link to "budgetweb.com" but
>which
>are not themselves at a URL containing "budgetweb.com".
>
>---
>Alex Chapman <alex@budgetweb.com> http://budgetweb.com/mercer/
>
>