RubyGems Navigation menu

spider 0.4.1

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

  1. 0.5.4 - June 04, 2020 (15.5 KB)
  2. 0.5.3 - April 23, 2018 (15 KB)
  3. 0.5.2 - April 23, 2018 (15 KB)
  4. 0.5.1 - September 04, 2016 (15 KB)
  5. 0.5.0 - May 13, 2016 (15 KB)
  6. 0.4.1 - November 10, 2007* (19.5 KB)
Show all versions (14 total)

Owners:

Authors:

  • Mike Burns

SHA 256 checksum:

620615a58b7c21dad6b8669bde162da766e69e11ea3f6ef05e0a432e2a8134ed

Total downloads 425,380

For this version 3,250

Licenses:

N/A

Required Ruby Version: > 0.0.0

Links: