tokenizers 0.4.4
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
复制到剪贴板
已复制!
安装:
=
版本列表:
- 0.4.4 - February 27, 2024 x86_64-linux (7.5 MB)
- 0.4.4 - February 27, 2024 x86_64-linux-musl (7.5 MB)
- 0.4.4 - February 27, 2024 x86_64-darwin (7.8 MB)
- 0.4.4 - February 27, 2024 arm64-darwin (7.4 MB)
- 0.4.4 - February 27, 2024 aarch64-linux (7.0 MB)
- 0.4.4 - February 27, 2024 (38.0 KB)