fizx-robots 0.7.1
It parses robots.txt files
Gemfile:
=
Copier
Copié!
installation:
=
Dépendances de Runtime (1):
fizx-loggable
> 0.0.0
Auteurs:
-
Kyle Maxwell, Sausheong Chang
Total de contrôle SHA 256:
777dd92b9d12f017d0abe63c1478ed7cfd2f2721585fa25ec906fc51195f2a34