I always see messages in the list that they talk about robot.txt,I have
some ideas but i donīt know very well what is robot.txt and in my server, I
noticed that dosenīt exist and i think that robot.txt is very important for
indexing a site.
Thanks for all
Alvaro Munoz
alvarom@fct.fidelca.es
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html