stupid_crawler 0.2.1

Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

0.2.1 - September 10, 2017 (8 KB)
0.2.0 - September 10, 2017 (8 KB)

Runtime Dependencies (1):

spidr ~> 0.6

Development Dependencies (2):

bundler ~> 1.12

rake ~> 10.0

Show all transitive dependencies

Owners:

Authors:

Jacob Burenstam

SHA 256 checksum:

ae72100eb481ed5f6b51fd00233954cf60c847b3535ea57350fcbf26f5ca7659