tokenizers 0.2.1-x86_64-linux
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
Copy to clipboard
Copied!
install:
=
Versions:
- 0.5.0 - May 21, 2024 x86_64-linux (5.69 MB)
- 0.5.0 - May 21, 2024 x86_64-linux-musl (5.67 MB)
- 0.5.0 - May 21, 2024 x86_64-darwin (5.9 MB)
- 0.5.0 - May 21, 2024 arm64-darwin (5.65 MB)
- 0.5.0 - May 21, 2024 aarch64-linux (5.29 MB)
- 0.2.1 - January 12, 2023 x86_64-linux (10.4 MB)