RubyGems Navigation menu

spider 0.5.0

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Versions:

  1. 0.5.3 - April 23, 2018 (15 KB)
  2. 0.5.2 - April 23, 2018 (15 KB)
  3. 0.5.1 - September 04, 2016 (15 KB)
  4. 0.5.0 - May 13, 2016 (15 KB)
  5. 0.4.4 - May 21, 2009 (30.5 KB)
Show all versions (13 total)

Authors:

  • John Nagro

Owners:

905e6bb5d089e0aa77448218f037fcd301b9172e9f53e0955a1af7458752aa9b

SHA 256 checksum:

0288b82ec22a8be4291bb206c7b8b715c45ba62afe25c4cabedd424cd7e835bf

Total downloads 314,619

For this version 4,323

Gemfile:
= Copy to clipboard Copied!

install:
=

Licenses:

N/A

Required Ruby Version: >= 0

Links: