Robot-version: 2.0
Disallow: /images
Should it retrieve "/images/huge.gif" or not?
If "yes", does that mean that the robot should treat the "/images" string
as an implicit regular expression equivalent to "/images*"?
If "no", then the "Robot-version" directive is more than a documentation
line since it modifies the robot's behavior.
-- LLLL LLLLL LLLLLL Arthur Matheny LIB 612 LL LL LL LL LL Academic Computing University of South Florida LLLLLL LLLLL LL matheny@usf.edu Tampa, FL 33620 LL LL LL LL LL 813-974-1795 FAX: 813-974-1799 LL LL LL LL LL http://www.acomp.usf.edu/_________________________________________________ This messages was sent by the robots mailing list. To unsubscribe, send mail to robots-request@webcrawler.com with the word "unsubscribe" in the body. For more info see http://info.webcrawler.com/mak/projects/robots/robots.html