re: Lycos unfriendly robot
Murray Bent (murrayb@icis.qut.edu.au)
Fri, 20 Oct 1995 02:18:16 +1000
According to Reinier Post:
>Lycos wants to index as many documents on a site it can find. This
>robot has only made two requests, and it didn't even retrieve our home page
>(/ is redirected to /win/, which is the actual home page). Perhaps it doesn't
>follow redirections.
>>Nick
>--
>Reinier Post reinpost@win.tue.nl
That may be fine if you have shares in Lycos or something. Do you?
mj