Re: robots.txt syntax

Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Next message: Martijn Koster: "Re: robots.txt syntax"
Previous message: Fred K. Lenherr: "robots.txt syntax"
Maybe in reply to: Fred K. Lenherr: "robots.txt syntax"
Next in thread: Martijn Koster: "Re: robots.txt syntax"

John D. Pritchard (jdp@cs.columbia.edu)
Fri, 11 Oct 1996 09:53:08 -0400

> Disallow: /
> Allow: /public/

a couple of people, including myself, have proposed this. one of us needs
to get around to writing a draft extending the present draft on
robots.txt.

-john