Collected information standards
Scott 'Webster' Wood (swood@thewild.com)
Fri, 21 Jun 1996 15:15:40 -0400 (EDT)
Well, I am not sure how soon I am going to be able to find or develop a
robot to do specifically what I need and the way I need to do it. My
current list is not soo big that I cannot begin it by hand, but I would hate
for my efforts to go to waste or be unmanageable in the future. Before I
delve into my own methodology for right and wrong, I was curious to know if
there are any writings or references to suggest possible methods for storing
data collected from the HTTP servers I am going to begin to parouse.
Preferably, I would like something versitile and inclusive that would be
able to later be easily converted to my robots storage format. Something
that would be regurged from an index or search engine. Are the data formats
specific per the robot/spider or is there some sort of standard in place?
Scott