Reverse dependencies for robotstxt Latest version of the following gems require robotstxt

hostelify 0.8.4

scrapper for publicly accessible data from hostelworld hostelbookers etc.

114,701 Downloads

site_analyzer 0.3.17

Create site report for SEO many options.

41,749 Downloads

rwspider 0.4.3

RW Spider is an multithreading spider client written in Ruby designed to make easy th...

7,973 Downloads

Total downloads 30,109

For this version 16,632

Licenses:
N/A

Required Ruby Version: None

Required Rubygems Version: >= 1.2

Links:

Homepage Source Code Documentation Download Review changes Badge RSS Report abuse Reverse dependencies