WebAnalyzer can do what you want. It doesn't have a scheduler build
in but it can be started by the command line for a specified
URL. Try a demo version at: http://www.incontext.com/demo/analyzer.html
Runs under Windows 3.1, 95 and NT.
----------
From: Steven Frank[SMTP:stevef@relation.com]
Sent: Friday, June 21, 1996 10:30 AM
To: robots@wc5.webcrawler.com
Subject: Looking for...
Hello,
I am looking for a robot which can perform the follow (nore or less):
-Take a URL or list of URLs as input
-Go to each of the specified sites
-Retrieve content (text) from each site and store it in a standard format
Some sort of integrated scheduler would be great, a command line version would also
be fine so an OS scheduler could be used.
Platform must be either Windows (3.x, 95, NT) or IBM AIX 3.2.5 (4.1?)
Am I asking too much or is something at least close to this available?
Thanks,
Steve
------ =_NextPart_000_01BB5F79.EBE8BA80
Content-Type: application/ms-tnef
Content-Transfer-Encoding: base64
eJ8+IjURAQaQCAAEAAAAAAABAAEAAQeQBgAIAAAA5AQAAAAAAADoAAENgAQAAgAAAAIAAgABBJAG
ADgBAAABAAAADAAAAAMAADADAAAACwAPDgAAAAACAf8PAQAAAFEAAAAAAAAAgSsfpL6jEBmdbgDd
AQ9UAgAAAAByb2JvdHNAd2M1LndlYmNyYXdsZXIuY29tAFNNVFAAcm9ib3RzQHdjNS53ZWJjcmF3
bGVyLmNvbQAAAAAeAAIwAQAAAAUAAABTTVRQAAAAAB4AAzABAAAAGgAAAHJvYm90c0B3YzUud2Vi
Y3Jhd2xlci5jb20AAAADABUMAQAAAAMA/g8GAAAAHgABMAEAAAAcAAAAJ3JvYm90c0B3YzUud2Vi
Y3Jhd2xlci5jb20nAAIBCzABAAAAHwAAAFNNVFA6Uk9CT1RTQFdDNS5XRUJDUkFXTEVSLkNPTQAA
AwAAOQAAAAALAEA6AQAAAAIB9g8BAAAABAAAAAAAAAPXPQEIgAcAGAAAAElQTS5NaWNyb3NvZnQg
TWFpbC5Ob3RlADEIAQSAAQATAAAAUkU6IExvb2tpbmcgZm9yLi4uALUFAQWAAwAOAAAAzAcGABUA
DQA7ADQABQBvAQEggAMADgAAAMwHBgAVAA0AOAAwAAUAaAEBCYABACEAAAAyMzY4ODI5MDYzQ0JD
RjExODgxRDA4MDA1QTNBNjE2NQDoBgEDkAYAQAUAABIAAAALACMAAAAAAAMAJgAAAAAACwApAAAA
AAADADYAAAAAAEAAOQAgvQdym1+7AR4AcAABAAAAEwAAAFJFOiBMb29raW5nIGZvci4uLgAAAgFx
AAEAAAAWAAAAAbtfm3IHkIJoJMtjEc+IHQgAWjphZQAAHgAeDAEAAAAFAAAAU01UUAAAAAAeAB8M
AQAAABMAAABjcmFpZ0BpbmNvbnRleHQuY2EAAAMABhAZKHibAwAHEMsCAAAeAAgQAQAAAGUAAABX
RUJBTkFMWVpFUkNBTkRPV0hBVFlPVVdBTlRJVERPRVNOVEhBVkVBU0NIRURVTEVSQlVJTERJTkJV
VElUQ0FOQkVTVEFSVEVEQllUSEVDT01NQU5ETElORUZPUkFTUEVDSUZJAAAAAAIBCRABAAAAzAMA
AMgDAAByBgAATFpGdX/2Jrb/AAoBDwIVAqgF6wKDAFAC8gkCAGNoCsBzZXQyNwYABsMCgzIDxQIA
cHJCcRHic3RlbQKDM3cC5AcTAoB9CoAIzwnZO/EWDzI1NQKACoENsQtg4G5nMTAzFFALChRRBQvy
YwBAIFdlYkGSbgdAeXoEkCBjA5GwZG8gdxGABUB5CGDDHBAAcHQuIEkFQBvwGQeQbicFQBGAdmUg
lGEgBPBoCYB1bBuB9GJ1AxBkCoULgB7BBUD2aQVAG7JiHfATwArAE9DiZB7AeSB0HlAboANw+wOB
IQBsC4Ad8AIQBcAeER5wBZAGkAiQHxZVUkx5HPBUciEwHhANsARgIJsd4BGgaQIgHgB0Oh2wQQJA
cDovL3cl8C5nC4AFoAIwZXgc4CGRLy0kci8AcBtELiWAbWz5CoVSdQYxKLAEgRrgC4AFG/B3BCAz
LjEsIIw5NR4AIeFOVC4KhSMKiyIQMTgwAtFpLXgxNDQN8AzQLKMLWTGuNgqgA2AT0GMFQC0ux+8K
hy17DDAuRkYDYSVgLV//LmQMggYAE9Ad4AOgMWAAcIBrW1NNVFA6E8HZHeBmQBYQC2B0JQEmwv5d
L28wfQZgAjAxrzK7MWDQaWRheSoASiiwHfBCMinxMTk5NjsAMGg6MzAUsE017zB9VB5vOC8yuwNg
BuB0c0Bgd2M1LncbAAUAYR53HpEmwjvvNv51YmqHLoE+DzK7TG9vawuAOmciUi5GcCrPK9MzNrct
RxpFLkZINSAVoCxGrPpJHgBtIgBF2B4BP+McEe5pEXAboyLQciJhSxAhUucCEEnBB+AobgWwHfAF
sRMekAQQKTpGrC1UYT5rHfIjwU6TBAAFQG9m2yOyBCBhBCALgHAf0E+m6kccAHQcAGUA0EywUVG/
IVIixx4gIAAHkE+mUhHAvwiBHeEmUwIwTjAmgikiUP8DYVMkVJIqQxPATmIgAR+R/x4RAZAh4AsR
IlIAwFJGCoX+UwNwIIEVsVFCC4AT0AnA9xxAVGIeR3cIYB8AIGIJwf8cQCoAHhAhmyTGXOQHQFsQ
vysmIHEjECIxX9EDkU8F8FceOAWgXQV1EbBkRp1QuzUxTUNtYrAFQCBxZSAA6x5QKTgoKdB4KgIq
ACqQI1bABbFJQk0UsElYSSnBMi4qMCg0KeA/2ilGrEFLEErhc0XzUwD/HABkcFNSH3EEIFsQB4Ah
UP9GAhxBHpBR0CARFaARsFLyO2sBUbF2C3ALYAJgZT/tRqxUEYA0IHNJ9jODRqxfRq9Hv0jMCoUV
MQB0EAMAEBAAAAAAAwAREAAAAABAAAcwwOuNBJtfuwFAAAgwwOuNBJtfuwEeAD0AAQAAAAUAAABS
RTogAAAAAN9+
------ =_NextPart_000_01BB5F79.EBE8BA80--