TokenEstimator is a Rails gem that allows you to count tokens in Excel, CSV, PDF, TXT, Markdown, and input text files using different tokenizers.

Required Ruby Version

>= 3.0.0

Authors

aemabit

Versions

  1. 0.1.2

    1. source

      1. 0.1.2 source July 15, 2024 (29 KB)
  2. 0.1.1

    1. source

      1. 0.1.1 source July 15, 2024 (16 KB)
  3. 0.1.0

    1. source

      1. 0.1.0 source July 11, 2024 (9 KB)

Pushed by

aeambit

SHA 256 checksum

← Previous version