tokenizers 0.4.4
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
Copy to clipboard
Copied!
install:
=
Versions:
- 0.4.4 - February 27, 2024 x86_64-linux (7.5 MB)
- 0.4.4 - February 27, 2024 x86_64-linux-musl (7.51 MB)
- 0.4.4 - February 27, 2024 x86_64-darwin (7.82 MB)
- 0.4.4 - February 27, 2024 arm64-darwin (7.45 MB)
- 0.4.4 - February 27, 2024 aarch64-linux (7 MB)
- 0.4.4 - February 27, 2024 (38 KB)
Runtime Dependencies (1):
rb_sys
>= 0