Re: An extended version of the Robots... (fwd)

Vu Quoc HUNG (hung@vsb.cz)
Tue, 12 Nov 1996 11:30:13 +0100 (MET)


Martijn,
I use classic robot w3mir to mirror the URL http://webspeed.progress.com.
If I use command `w3mir -r http://webspeed.progress.com/`,
I got nothing !!
If I use command `w3mir -r http://webspeed.progress.com/index.html`
I got only one file index.html.

As you can see, w3mir can't work with the tags "FRAME" or "<A
HREF="/cgi-bin/content.cgi/template.p/products/webspeed/nfindex.html">HERE</A>"
^^^^^^ !!!!! ^^^^^^^^^^^^^^^
in the file webspeed.progress.com/index.html. So that he can't download
recursively all documents on webspeed.progress.com.
I need a BETTER robot, which can work with tag "FRAME" or cgi script.
But I don't know which robot is the BEST at this time, and where can I
download from. Please, let me know. Thank you very much.

Here is the content of the file http://webspeed.progress.com/index.html:

<HTML>
<HEAD>
<TITLE>WebSpeed Home Page</TITLE>
</HEAD>
<FRAMESET ROWS="60,45,*" FRAMEBORDER=NO BORDER=0>
<FRAME SRC="/general/navbara.html" MARGINHEIGHT=0 MARGINWIDTH=8 NAME="A" SCROLLING=NO>
<FRAME SRC="/cgi-bin/content.cgi/template.p/products/webspeed/feature.html" MARGINHEIGHT=0 MARGINWIDTH=8 NAME="B" SCROLLING=NO>
<FRAMESET COLS="165,*" FRAMEBORDER=NO BORDER=0 NAME="CD">
<FRAME SRC="navbarb.html" NAME="C" MARGINHEIGHT=0 MARGINWIDTH=8>
<FRAME SRC="/cgi-bin/content.cgi/template.p/products/webspeed/index.html" NAME="D" MARGINHEIGHT=0 MARGINWIDTH=8>
</FRAMESET>
</FRAMESET>
<NOFRAME>
<BODY BGCOLOR="#FFFFFF" TEXT="#000000" LINK="#00007F" VLINK="#666666"
ALINK="#FF0000">
<CENTER><P><TABLE WIDTH="444" BORDER="0" CELLSPACING="0" CELLPADDING="0">
<TR>
<TD WIDTH="293" VALIGN="BOTTOM"><BR CLEAR="ALL"><BR CLEAR="ALL"><IMG
SRC="/images/wshomep.gif"
WIDTH="293" HEIGHT="128" ALIGN="TOP" NATURALSIZEFLAG="3"></TD>
<TD WIDTH="12" VALIGN="TOP">NS</TD>
<TD WIDTH="145"><IMG SRC="/images/wsillus.jpeg" WIDTH="145" HEIGHT=
"146" ALIGN="BOTTOM" NATURALSIZEFLAG="3"></TD></TR>
</TABLE>
</P></CENTER>
<H1 ALIGN=CENTER>Welcome to webspeed.progress.com!<BR>If your browser does
not support frames,<BR>click <A
HREF="/cgi-bin/content.cgi/template.p/products/webspeed/nfindex.html">HERE</A>.</H1>
</BODY>
</NOFRAME>
</HTML>

Hung.

=====================================================================
Ing. Vu Quoc HUNG Technical university of Ostrava.

private: office:
Kolej VSB - E337 VSB-TU, information center.
Ostrava - Poruba phone: +42-69-6993479.
70833 - Czech republic.
E-mail : hung@vsb.cz