robots.txt changes how often?
Tangy Verdell (TVerdell@dca.com)
Wed, 14 Feb 96 09:32:58 EST
in my robot, i don't want to check the robots.txt everytime i visit
that host because i think that robots.txt doesn't change very often -
ususally.
is this true?