RubyGems Navigation menu

spider 0.4.4

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Gemfile
          gem 'spider', '~> 0.4.4'
  
  
  
  
  
  
  

install
          gem install spider
  
  
  
  
  
  
  

Total downloads 268,198

For this version 212,256

Show all versions (9 total)

Required Ruby Version: None

Links:

Versions:

  1. 0.4.4 - May 21, 2009 (30.5 KB)
  2. 0.4.3 - October 9, 2008 (20.5 KB)
  3. 0.4.2 - July 6, 2008 (20.5 KB)
  4. 0.4.1 - November 10, 2007 (19.5 KB)
  5. 0.4.0 - November 2, 2007 (19 KB)
Show all versions (9 total)