Re: robot.polite

Ross Finlayson (raf@hiway.tomco.net)
Tue, 18 Jun 1996 21:16:29 -0400


THis sounds like a good idea to me. : )

>and perhaps, for distributed indexing, we might have hooks to a local index
>file with a standardized format... so that an offsite index could get the
>local index in one fell swoop?
>
>Something like
> altavista-format: /path/indexfile.db
> or
>more generally,
>
> local index format:
> local index path:
>
>les
>nf.ca
>
>