tokenzr | RubyGems.org | your community gem host

RubyGems

Sign in Sign up

Gemfile

install

Tokenizer for most common cases of tokenization

Required Ruby Version

>= 3.0

Authors

David Siaw

Versions

0.1.0 July 22, 2026 (6.5 KB)

Pushed by

SHA 256 checksum