gtokenizer 1.0.0
GTokenizer recreates the closed-source tokenization library used by Google for their Google NGrams app (http://ngrams.googlelabs.com/), based on the information in the associated Science paper (http://www.sciencemag.org/content/suppl/2010/12/16/science.1199644.DC1/Michel.SOM.revision.2.pdf)
Gemfile:
=
Copier
Copié!
installation:
=
Versions:
- 1.0.0 - July 02, 2011 (6,5 ko)
Dépendances de Development (1):
rspec
>= 0
Propriétaires:
Auteurs:
-
Alex Peattie
Total de contrôle SHA 256:
7eb5615caee4e15a2d5baa63577f3dce14dc361940725e2e7f72b976df7704a3