jeremyf-robot_rules 0.9.1

A tool to determine if the robots.txt would prevent a given user agent from making a request to a given URI.

Gemfile:
= 複製已複製

安裝:
=

版本列表:

0.9.1 - August 11, 2014 (7.0 KB)

作者:

James Edward Gray II, Jeremy Friesen

SHA 256 checksum:

7910715811b5624708a508751122cf2b58e07cd59f030241eddaef5b8ab7fed9