May have to try this out, cool how Mozilla can be extended. I wonder if it works with Firefox too?
Mozilla-based Spiders Version 0.0.1.7
Author Bob Clary
Created 2004-07-10, Modified 2005-12-14
Web Spider applications have a multitude of possible applications ranging from search indexes, web site quality assurance testing to testing browser implementations. This article introduces an improved mozilla-based Web Spider application framework which can be adapted for many different uses.
* What’s New
* CSpider.js – A New and Improved Spider Framework
* Spider – A Mozilla Application based upon CSpider.js
* Real World Applications of Spider
* Links and Stuff