I am new to the list and thought I would make an introduction. I work at InContext Systems
and I am the lead developer on our WebAnalyzer product. The WebAnalyzer takes a URL
and traverses the all the links off it. It can make a local copy of the site, show a
visualization of the site and produce and HTML report of the analysis (ie report on
broken links etc.).
I have joined this list because I am interested in making WebAnalyzer more "net friendly".
I intend to implement the robot exclusion protocal and anything else that comes up.
If you are interested in looking at WebAnalyzer it runs under windows 3.1, 95 and NT
and a eval copy can be had at: http://www.incontext.com/demo/analyzer.html
Looking forward to discussions on this list.
Craig McQueen
InContext Systems
http://www.incontext.com/staff/craig/craig.html