Re: Horror story

Brian Pinkerton ((no email))
Sun, 14 Jan 96 22:40:09 -0800


The robots.txt format got some good press in the Nov. issue of WebWeek, and
more extensive coverage on the whole robots issue is in the works.

Skip is right: a lot of people want as much exposure as possible, and aren't
likely to pay attention to ideas that might reduce that exposure! On the
flip side, offering a way to specify what files on a site are most important
*to* index would be seen as a big step forward. Martijn may have more to say
on this issue. :)

cheers,
bri