tokenkit 0.1.0.pre.2-arm64-darwin

TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Gemfile:
=

install:
=

Versions:

0.1.0.pre.2 June 20, 2026 arm64-darwin (3.62 MB)
0.1.0.pre.2 June 20, 2026 aarch64-linux (3.88 MB)
0.1.0.pre.2 June 20, 2026 x86_64-linux (4.05 MB)
0.1.0.pre.2 June 20, 2026 (885 KB)
0.1.0.pre.1 September 29, 2025 (38.5 KB)

Runtime Dependencies (1):

rb_sys ~> 0.9

Development Dependencies (5):

rake ~> 13.0

rake-compiler ~> 1.2

rspec ~> 3.0

simplecov ~> 0.22

standard ~> 1.3

Show all transitive dependencies

Requirements:

Rust >= 1.85

Owners:

Pushed by:

Authors:

Chris Petersen

tokenkit 0.1.0.pre.2-arm64-darwin

Gemfile:
=

install:
=

Versions:

Runtime Dependencies (1):

Development Dependencies (5):

Requirements:

Owners:

Pushed by:

Authors:

SHA 256 checksum:

Total downloads 734

For this version 80

Version Released:
June 20, 2026 3:03am

License:
MIT

Required Ruby Version: >= 3.1.0

Links:

tokenkit 0.1.0.pre.2-arm64-darwin

Gemfile: =

install: =

Versions:

Runtime Dependencies (1):

Development Dependencies (5):

Requirements:

Owners:

Pushed by:

Authors:

SHA 256 checksum:

Total downloads 734

For this version 80

Version Released: June 20, 2026 3:03am

License: MIT

Required Ruby Version: >= 3.1.0

Links:

Gemfile:
=

install:
=

Version Released:
June 20, 2026 3:03am

License:
MIT