RubyGems Navigation menu

robotstxt 0.5.4

Robotstxt Parser allows you to the check the accessibility of URLs and get other data. Full support for the robots.txt RFC, wildcards and Sitemap: rules.

Gemfile:
= Copier Copié!

installation:
=

Versions:

  1. 0.5.4 - February 13, 2010 (7,5 ko)
  2. 0.5.3 - February 13, 2010 (7,5 ko)
  3. 0.5.2 - December 19, 2009 (7,5 ko)
  4. 0.5.1 - December 06, 2009 (5 ko)
  5. 0.5.0 - December 06, 2009 (5 ko)

Dépendances de Development (2):

echoe ~> 3.1
rake ~> 0.8

Propriétaires:

Auteurs:

  • Simone Rinzivillo

Total de contrôle SHA 256:

80e10ba5508fb0b9bac13fbe3dee66c078270506a429e528016a085725da84dc

Total de téléchargements 30 269

Pour cette version 16 680

License:

aucune

Version de Ruby requise: None

Required Rubygems Version: >= 1.2

Liens: