RubyGems Navigation menu

creepy-crawler 1.0.0

web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site

Versions:

  1. 1.0.2 - May 10, 2014 (189 KB)
  2. 1.0.0 - May 10, 2014 (189 KB)
Show all versions (3 total)

Runtime Dependencies (7):

  • addressable >= 2.3.6, ~> 2.3
  • neography >= 1.4.1, ~> 1.4
  • nokogiri >= 1.6.1, ~> 1.6
  • open_uri_redirections = 0.1.4
  • rake ~> 0.8
  • trollop ~> 2.0
  • webrobots >= 0.1.1, ~> 0.1
  • Development Dependencies (3):

  • bundler ~> 1.5
  • rspec ~> 2.14
  • rspec-core ~> 2.14
  • Owners:

    Authors:

    • Ryan Grothouse

    SHA 256 checksum:

    eabed1e311ab4443a662c472d5e972b688ead6eccf4b85132666ea54e8010487

    Total downloads 4,339

    For this version 1,831

    Gemfile:
    = Copy to clipboard Copied!

    install:
    =

    License:

    MIT

    Required Ruby Version: >= 1.9.3

    Links: