creepy-crawler 1.0.0

web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

1.0.2 - May 10, 2014 (189 KB)
1.0.0 - May 10, 2014 (189 KB)

Show all versions (3 total)

Runtime Dependencies (7):

addressable >= 2.3.6, ~> 2.3

neography >= 1.4.1, ~> 1.4

nokogiri >= 1.6.1, ~> 1.6

open_uri_redirections = 0.1.4

rake ~> 0.8

trollop ~> 2.0

webrobots >= 0.1.1, ~> 0.1

Development Dependencies (3):

bundler ~> 1.5

rspec ~> 2.14

rspec-core ~> 2.14

Show all transitive dependencies

Owners:

Authors:

Ryan Grothouse

SHA 256 checksum:

eabed1e311ab4443a662c472d5e972b688ead6eccf4b85132666ea54e8010487