RubyGems Navigation menu

link_scraper 2.1

Scrape website links' text and path with built-in scrubbing filter. Designed to rapidly visit and scrape links from list of several URLs, then filters them based on your criteria. For example, to only grab the links for inventory, staff, or contact us, etc.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

  1. 2.1 - July 11, 2018 (14 KB)
  2. 2.0 - July 10, 2018 (14 KB)
  3. 1.02 - July 04, 2018 (14 KB)
  4. 1.01 - July 04, 2018 (10.5 KB)

Runtime Dependencies (5):

activesupport ~> 5.2
crm_formatter ~> 2.65
mechanizer ~> 1.12
scrub_db ~> 2.24
url_verifier ~> 2.12

Development Dependencies (4):

bundler >= 1.16.2, ~> 1.16
pry ~> 0.11.3
rake >= 12.3.1, ~> 12.3
rspec ~> 3.7

Owners:

Authors:

  • Adam Booth

SHA 256 checksum:

6739bb27e7d8610378d5674fff85c7e4b42cc25130a93d876060d3e7c706aba6

Total downloads 6,594

For this version 2,010

License:

MIT

Required Ruby Version: ~> 2.5.1

Links: