robotstxt-rb 1.0.0
Enables fast, standards-compliant robots.txt parsing and URL access checking directly from Ruby.
Gemfile:
=
install:
=
Versions:
- 1.0.0 October 23, 2025 (124 KB)
Runtime Dependencies (1):
ffi
~> 1.16