I just wrote a tiny CGI program counting unique visits to my sponsors
pages. It is called like
http://my.domain.com/redirect/redirect.exe/dest.domain.com/path/file.ext
It first does some logging and then makes the server send a '302 Moved
Temporarily' status code including the new destination URL
dest.domain.com/path/file.ext. If your browser follows this link it
will finally display this URL.
My question is: What do spiders usually do when they come across such a
link?
Will they follow the redirection? If yes, which URL is then indexed?
This seems to be important for commercial purposes (pay-per-hits). If
the final (destination) URL is indexed, my program will be useless.
Thanks
Patrick
___________________________________________________
Looking for a smart Search Engine Interface?
Visit -> HyperSeek <-
http://www.wallace.isoe.ch/hyperseek/
___________________________________________________
brought to you by Patrick Berchtold
_________________________________________________
This messages was sent by the robots mailing list. To unsubscribe, send mail
to robots-request@webcrawler.com with the word "unsubscribe" in the body.
For more info see http://info.webcrawler.com/mak/projects/robots/robots.html