arachnid 0.3.0

Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Gemfile:
= Copy to clipboard Copied!

instalar:
=

Versões:

0.4.1 - January 17, 2014 (5 KB)
0.4.0 - January 16, 2014 (4,5 KB)
0.3.2 - January 16, 2014 (5 KB)
0.3.1 - January 16, 2014 (5 KB)
0.3.0 - January 16, 2014 (4,5 KB)

Mostrar todas as versões (12)

Runtime Dependencies (4):

bloomfilter-rb = 2.1.1

domainatrix = 0.0.10

nokogiri = 1.5.0

typhoeus = 0.3.2

Mostrar todas as dependências

Donos:

Autores:

dchuk

SHA 256 checksum:

f24377950454297b32b80c33b8e9dc009e626447a51479c2ea763ce4c7c8e037

arachnid 0.3.0

Gemfile:
= Copy to clipboard Copied!

instalar:
=

Versões:

Runtime Dependencies (4):

Donos:

Autores:

SHA 256 checksum:

Total de downloads 48.741

Desta versão 3.327

Licenças:
N/A

Versão Requerida do Ruby: Nenhum

Links:

arachnid 0.3.0

Gemfile: = Copy to clipboard Copied!

instalar: =

Versões:

Runtime Dependencies (4):

Donos:

Autores:

SHA 256 checksum:

Total de downloads 48.741

Desta versão 3.327

Licenças: N/A

Versão Requerida do Ruby: Nenhum

Links:

Gemfile:
= Copy to clipboard Copied!

instalar:
=

Licenças:
N/A