RubyGems Navigation menu

robotstxt 0.5.4

Robotstxt Parser allows you to the check the accessibility of URLs and get other data. Full support for the robots.txt RFC, wildcards and Sitemap: rules.

Gemfile:
= Copy to clipboard Copied!

instalar:
=

Versões:

  1. 0.5.4 - February 13, 2010 (7,5 KB)
  2. 0.5.3 - February 13, 2010 (7,5 KB)
  3. 0.5.2 - December 19, 2009 (7,5 KB)
  4. 0.5.1 - December 06, 2009 (5 KB)
  5. 0.5.0 - December 06, 2009 (5 KB)

Development Dependencies (2):

echoe ~> 3.1
rake ~> 0.8

Donos:

Autores:

  • Simone Rinzivillo

SHA 256 checksum:

= Copy to clipboard Copied!

Total de downloads 30.279

Desta versão 16.682

Licenças:

N/A

Versão Requerida do Ruby: Nenhum

Versão Requerida do RubyGems: >= 1.2

Links: