robots-audit fetches a site's robots.txt (following redirects), parses it per the robots exclusion protocol, and reports actionable findings: parse violations, orphan Disallow lines, missing wildcard User-agent coverage, missing sitemap declarations, unexpected HTTP statuses, and oversize files. Zero runtime dependencies — stdlib only (net/http, uri, optparse, json). Use it for SEO hygiene checks, crawl-budget reviews, and CI gates.

Required Ruby Version

>= 2.7.0

Authors

DeveloApps

Versions

  1. 1.0.0
    1. source

      1. 1.0.0 source October 24, 2026 (9 KB)

SHA 256 checksum