RubyGems Navigation menu

spider 0.5.1

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Versions:

  1. 0.5.3 - April 23, 2018 (15 KB)
  2. 0.5.2 - April 23, 2018 (15 KB)
  3. 0.5.1 - September 04, 2016 (15 KB)
  4. 0.5.0 - May 13, 2016 (15 KB)
  5. 0.4.4 - July 25, 2009 (30.5 KB)
Show all versions (13 total)

Owners:

Authors:

  • John Nagro

SHA 256 checksum:

24997cedd3dd5aec73f6fd08338a47a8bacc6c6847caa40161f601f6aa9bd001

Total downloads 333,132

For this version 22,206

Gemfile:
= Copy to clipboard Copied!

install:
=

License:

MIT

Required Ruby Version: >= 0

Links: