RubyGems Navigation menu

tokn 0.1.1

Given a script containing token descriptions (each a regular expression), tokn compiles an automaton which it can then use to efficiently convert a text file to a sequence of those tokens.

Gemfile:
=

install:
=

Versions:

  1. 0.1.1 April 15, 2013 (117 KB)
  2. 0.1.0 April 09, 2013 (30.5 KB)
  3. 0.0.9 April 04, 2013 (28 KB)
  4. 0.0.8 April 04, 2013 (28.5 KB)
  5. 0.0.6 March 16, 2013 (44.5 KB)
Show all versions (9 total)

Owners:

Authors:

  • Jeff Sember

SHA 256 checksum:

=

Total downloads 20,100

For this version 3,889

Version Released:

License:

mit

Required Ruby Version: None

Links: