RubyGems Navigation menu

gtokenizer 1.0.0

GTokenizer recreates the closed-source tokenization library used by Google for their Google NGrams app (http://ngrams.googlelabs.com/), based on the information in the associated Science paper (http://www.sciencemag.org/content/suppl/2010/12/16/science.1199644.DC1/Michel.SOM.revision.2.pdf)

Versions:

  1. 1.0.0 - July 1, 2011 (6.5 KB)

Development Dependencies:

Authors:

  • Alex Peattie

Owners:

716521667807b542d722f51281f97e72

Total downloads 1,386

For this version 1,386

Required Ruby Version: None

Licenses:

N/A

Gemfile:
gem 'gtokenizer', '~> 1.0.0' = Copy to clipboard Copied!

install:
gem install gtokenizer = Copy to clipboard Copied!

Links: