Given a script containing token descriptions (each a regular expression), tokn compiles an automaton which it can then use to efficiently convert a text file to a sequence of those tokens.

Required Ruby Version

None

Authors

Jeff Sember

Versions

  1. 0.1.1

    1. source

      1. 0.1.1 source April 15, 2013 (117 KB)
  2. 0.1.0

    1. source

      1. 0.1.0 source April 09, 2013 (30.5 KB)
  3. 0.0.9

    1. source

      1. 0.0.9 source April 04, 2013 (28 KB)
  4. 0.0.8

    1. source

      1. 0.0.8 source April 04, 2013 (28.5 KB)
  5. 0.0.6

    1. source

      1. 0.0.6 source March 16, 2013 (44.5 KB)
Show all versions (9 total)

SHA 256 checksum

← Previous version