fizx-fizx-robots 0.4.0
It parses robots.txt files
Gemfile:
=
Copier
Copié!
installation:
=
Versions:
- 0.4.0 - August 11, 2014 (5 ko)
Dépendances de Runtime (1):
fizx-loggable
> 0.0.0
Auteurs:
-
Kyle Maxwell
Total de contrôle SHA 256:
24a9ed9545b3f3fa737fb82c904e4420445fd63e9f58591720b691f7b88b1169