allow
deny
preferred indexing time
preferred indexing frequency
and perhaps, for distributed indexing, we might have hooks to a local index
file with a standardized format... so that an offsite index could get the
local index in one fell swoop?
Something like
altavista-format: /path/indexfile.db
or
more generally,
local index format:
local index path:
les
nf.ca