sentencepiece.rb provides Ruby bindings for the SentencePiece, an unsupervised text tokenizer and detokenizer for neural network-based text generation.
Required Ruby Version
>= 0
Authors
yoshoku
Versions
-
0.2.1
-
source
- 0.2.1 source February 16, 2026 (15 KB)
-
-
0.2.0
-
source
- 0.2.0 source December 29, 2025 (15 KB)
-
-
0.1.0
-
source
- 0.1.0 source March 26, 2023 (14.5 KB)
-
-
0.0.2
-
source
- 0.0.2 source March 26, 2023 (14.5 KB)
-
-
0.0.1
-
source
- 0.0.1 source March 21, 2023 (13 KB)
-