RubyGems Navigation menu

spidercrawl 0.3.9

With the help of Nokogiri, SpiderCrawl will parse each page and return you its title, links, css, words, and many many more! You can also customize what you want to do before & after each fetch request.

Gemfile:
= Copy to clipboard Copied!

install:
=

Versions:

  1. 0.3.9 - March 10, 2016 (10.5 KB)

Runtime Dependencies (4):

colorize >= 0
curb >= 0
nokogiri ~> 1.6
typhoeus >= 0

Development Dependencies (2):

bundler ~> 1.7
rake ~> 10.0

Owners:

Authors:

  • Belson Heng

SHA 256 checksum:

392ed9c8a9ce8ecf869176415caf1d3ff53ae9996acdf785050294ace66d8957

Total downloads 2,683

For this version 2,683

License:

MIT

Required Ruby Version: >= 0

Links: