RubyGems Navigation menu

jeremyf-robot_rules 0.9.1

A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Gemfile:
=

install:
=

Versions:

  1. 0.9.1 August 11, 2014 (7 KB)

Authors:

  • James Edward Gray II, Jeremy Friesen

SHA 256 checksum:

=

Total downloads 3,531

For this version 3,531

Version Released:

Licenses:

N/A

Required Ruby Version: >= 0

Links: