Enables fast, standards-compliant robots.txt parsing and URL access checking directly from Ruby.
Required Ruby Version
>= 2.0
Authors
Jackson Trieu
Versions
-
1.0.0
-
source
- 1.0.0 source October 23, 2025 (124 KB)
-
Enables fast, standards-compliant robots.txt parsing and URL access checking directly from Ruby.
>= 2.0
Jackson Trieu
source