spider 0.4.2

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

0.5.4 - June 04, 2020 (15.5 KB)
0.5.3 - April 23, 2018 (15 KB)
0.5.2 - April 23, 2018 (15 KB)
0.5.1 - September 04, 2016 (15 KB)
0.5.0 - May 13, 2016 (15 KB)
0.4.2 - July 06, 2008^* (20.5 KB)

Show all versions (14 total)

Owners:

Authors:

John Nagro

SHA 256 checksum:

07ba26009ba985426696d6e0e0667d0aecac3621cb5c5e77fff32860b92deb51