what about urls with %xx characters escaped? That is, would robots and
search engines index the following two urls as different urls or the same?
http://whatever.com/~someone/index.html
http://whatever.com/%7esomeone/index.html
-Dan
============================================================================
Dan Gildor inTouch Technologies
gyld@in-touch.com (415) 366-2482
http://www.in-touch.com Multimedia * PC * Mac * Unix * WWW
============================================================================
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html