A multilingual tokenizer to split a string into tokens.
Required Ruby Version
>= 0
Authors
Kevin S. Dias
Versions
-
3.2.1
-
source
- 3.2.1 source August 11, 2024 (71 KB)
-
-
3.2.0
-
source
- 3.2.0 source November 29, 2020 (71 KB)
-
-
3.1.0
-
source
- 3.1.0 source July 10, 2020 (70.5 KB)
-
-
3.0.7
-
source
- 3.0.7 source March 18, 2018 (70.5 KB)
-
-
3.0.6
-
source
- 3.0.6 source March 15, 2018 (72.5 KB)
-