robots-audit fetches a site's robots.txt (following redirects), parses it per the robots exclusion protocol, and reports actionable findings: parse violations, orphan Disallow lines, missing wildcard User-agent coverage, missing sitemap declarations, unexpected HTTP statuses, and oversize files. Zero runtime dependencies — stdlib only (net/http, uri, optparse, json). Use it for SEO hygiene checks, crawl-budget reviews, and CI gates.
Required Ruby Version
>= 2.7.0
Authors
DeveloApps
Versions
-
1.0.0
-
source
- 1.0.0 source October 24, 2026 (9 KB)
-