fizx-robots 0.6.0
It parses robots.txt files
Gemfile:
=
Copy to clipboard
Copied!
install:
=
Runtime Dependencies (1):
fizx-loggable
> 0.0.0
Authors:
-
Kyle Maxwell, Sausheong Chang
SHA 256 checksum:
41625269030443c1dcd9c467600fb59c260a7c8c3da6b414343563716980b1cf