The SimpleCrawler module is a library for crawling web sites. The crawler provides comprehensive data from the page crawled which can be used for page analysis, indexing, accessibility checks etc. Restrictions can be specified to limit crawling of binary files.
Required Ruby Version
>= 1.8.2
Authors
Peter Krantz
Versions
- 0.1.8 November 02, 2011 (6.5 KB)
- 0.1.7 May 03, 2009This gem version was imported to RubyGems.org on July 25, 2009. The date displayed was specified by the author in the gemspec. (9.5 KB)
- 0.1.6 November 27, 2008This gem version was imported to RubyGems.org on July 25, 2009. The date displayed was specified by the author in the gemspec. (6.5 KB)
- 0.1.4 September 16, 2008This gem version was imported to RubyGems.org on July 25, 2009. The date displayed was specified by the author in the gemspec. (6.5 KB)
- 0.1.3 January 25, 2008This gem version was imported to RubyGems.org on July 25, 2009. The date displayed was specified by the author in the gemspec. (6.5 KB)