Tiktoken tokenizer for Roseflow.

Required Ruby Version

>= 3.2.0

Authors

Lauri Jutila

Versions

  1. 0.2.0

    1. source

      1. 0.2.0 source July 19, 2023 (8 KB)
  2. 0.1.0

    1. source

      1. 0.1.0 source May 10, 2023 (8 KB)

Pushed by

ljuti

SHA 256 checksum

← Previous version