RubyGems.org

tokenizer

0.0.1.prealpha

A simple tokenizer for NLP tasks.

installgem install tokenizer --pre
Download Documentation Subscribe RSS
Authors

Andrei Beliankou

2,200 total downloads 243 for this version
Owners

9183f2f97a2f44594196cab39cbe5928

Links
Homepage Source Code Bug Tracker
Gemfile
gem "tokenizer", "~> 0.0.1.prealpha"
Versions
  1. 0.1.1 August 24, 2011
  2. 0.1.0 May 18, 2011
  3. 0.0.1.prealpha May 5, 2011