robotstxt-rb 1.0.0
Enables fast, standards-compliant robots.txt parsing and URL access checking directly from Ruby.
Gemfile:
=
instalar:
=
Versiones:
- 1.0.0 October 23, 2025 (124 KB)
dependencias de Runtime (1):
ffi
~> 1.16