RubyGems Navigation menu

spider 0.3.0

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Versions:

  1. 0.5.0 - May 13, 2016 (15 KB)
  2. 0.4.4 - May 21, 2009 (30.5 KB)
  3. 0.4.3 - October 9, 2008 (20.5 KB)
  4. 0.4.2 - July 6, 2008 (20.5 KB)
  5. 0.4.1 - November 10, 2007 (19.5 KB)
Show all versions (10 total)

Authors:

  • Mike Burns

Owners:

905e6bb5d089e0aa77448218f037fcd301b9172e9f53e0955a1af7458752aa9b

SHA 256 checksum:

9ea127384c5fbfc5969fac2989128424c6f5137344a0cbcbedbd4bc5d3f42c01

Total downloads 283,253

For this version 1,691

Gemfile:
= Copy to clipboard Copied!

install:
=

Licenses:

N/A

Required Ruby Version: None

Links: