RubyGems.org

1. A robot may not index staging servers 2. A robot must obey the sitemap 3. A robot may not injure SEO or, through inaction, cause SEO to come to harm.

installgem install laws_of_robots_txt
Authors

John Hawthorn

838 total downloads 838 for this version
Owners

Ec81d9cd659b1823a1dd321a2b547faa

Licenses

MIT

Gemfile
gem 'laws_of_robots_txt', '~> 0.0.1'
Versions
  1. 0.0.1 November 25, 2013 (7.5 KB)