> I've written a robot+searchengine (www.il.ft.hse.nl/ilse (dutch sites only))
> and I just implemented the robots.txt 'stay away' stuff, but it caused some
> problems...
we are currently out-sketching a developping-plan for a similar engine for Switzerland and are a little stuck concerning the
format of the database as neither of the different approaches really pleases us. As your engine has to satisfy aproxamitely
the same needs as ours we would be really eager to get some more information about your aproach.
What system/OS are you running and what kind of hardware is it backing up?
In what language and what database software are you using?
On what database format and search routines are you based on?
Any information would be grealtly appreciated, thanks yours
Ulrich Ruffiner