fizx-fizx-robots 0.4.0
It parses robots.txt files
Gemfile:
=
Copy to clipboard
Copied!
install:
=
Versions:
- 0.4.0 - August 11, 2014 (5 KB)
Runtime Dependencies (1):
fizx-loggable
> 0.0.0
Authors:
-
Kyle Maxwell
SHA 256 checksum:
24a9ed9545b3f3fa737fb82c904e4420445fd63e9f58591720b691f7b88b1169