RubyGems Navigation menu

gtokenizer 1.0.0

GTokenizer recreates the closed-source tokenization library used by Google for their Google NGrams app (http://ngrams.googlelabs.com/), based on the information in the associated Science paper (http://www.sciencemag.org/content/suppl/2010/12/16/science.1199644.DC1/Michel.SOM.revision.2.pdf)

Gemfile
          gem 'gtokenizer', '~> 1.0.0'
  
  
  
  
  
  
  

install
          gem install gtokenizer
  
  
  
  
  
  
  

Total downloads 1,384

For this version 1,384

Required Ruby Version: None

Links:

Versions:

  1. 1.0.0 - July 1, 2011 (6.5 KB)

Development Dependencies: