robotstxt 0.5.4

Robotstxt Parser allows you to the check the accessibility of URLs and get other data. Full support for the robots.txt RFC, wildcards and Sitemap: rules.

Gemfile:
= 複製已複製

安裝:
=

版本列表:

0.5.4 - February 13, 2010 (7.5 KB)
0.5.3 - February 13, 2010 (7.5 KB)
0.5.2 - December 19, 2009 (7.5 KB)
0.5.1 - December 06, 2009 (5.0 KB)
0.5.0 - December 06, 2009 (5.0 KB)

Development 相依性套件 (2):

echoe ~> 3.1

rake ~> 0.8

Show all transitive dependencies

擁有者:

作者:

Simone Rinzivillo

SHA 256 checksum:

80e10ba5508fb0b9bac13fbe3dee66c078270506a429e528016a085725da84dc