RubyGems Navigation menu

arachnid 0.4.1

Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Versions:

  1. 0.4.1 - January 16, 2014 (5 KB)
  2. 0.4.0 - January 16, 2014 (4.5 KB)
  3. 0.3.2 - January 16, 2014 (5 KB)
  4. 0.3.1 - January 16, 2014 (5 KB)
  5. 0.3.0 - January 16, 2014 (4.5 KB)
Show all versions (12 total)

Authors:

  • dchuk

Owners:

9ac85e387283cefc5a48e463f812ef71

Sha 256 checksum:

7c3542de515c8961318d44ca78a2431fefb35d5941c28ba2abcbbb0d8cd8bc3d

Total downloads 16,330

For this version 854

Show all versions (12 total)

Required Ruby Version: None

Licenses:

N/A

Gemfile:
= Copy to clipboard Copied!

install:
= Copy to clipboard Copied!

Links: