Toy is a pure-Ruby transformer LM that compiles to a native binary via Spinel. Inference (KV-cache decode on CPU/CUDA/Metal), training (LoRA/full-FT/from-scratch via tinynn-FFI'd ggml), GGUF load + save, Tao-compatible events.jsonl emission. As a gem, it exposes the primitives a research project composes: tinynn FFI bridges, the sequence-forward training graph, ViT-Tiny, the Llama / SmolLM2 / Qwen2.5 inference cache, the GGUF loader, drift/grad/CKA observability, cosine LR schedules, and the GGUF checkpoint writer. Filed as toy#19; pairs with bundler-spinel / spinelgems for the consumer vendor flow.

Required Ruby Version

>= 3.2.0

Authors

Ori Pekelman

Versions

  1. 0.9.0
    1. source

      1. 0.9.0 source June 27, 2026 (3.38 MB)
  2. 0.8.0
    1. source

      1. 0.8.0 source June 13, 2026 (3.36 MB)
Show all versions (5 total)

Pushed by

SHA 256 checksum