robots.txt parser and evaluator according to RFC 9309.
Required Ruby Version
>= 3.1
Authors
Alexander Mankuta
Pushed by
SHA 256 checksum
Signature validity period
November 09, 2023 -
November 08, 2024
(expired)
robots.txt parser and evaluator according to RFC 9309.
>= 3.1
Alexander Mankuta