fizx-fizx-robots 0.4.0
It parses robots.txt files
Gemfile:
=
复制到剪贴板
已复制！
安装:
=
版本列表:
- 0.4.0 - August 11, 2014 (5.0 KB)
Runtime 依赖 (1):
fizx-loggable
> 0.0.0
作者:
-
Kyle Maxwell
SHA 256 校验和:
24a9ed9545b3f3fa737fb82c904e4420445fd63e9f58591720b691f7b88b1169