Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.

Required Ruby Version

>= 3.1.0

Required Rubygems Version

>= 3.3

Authors

Christopher Petersen, kojix2

Versions

  1. 1.8.1

    1. source

      1. 1.8.1 source June 20, 2026 (129 KB)

    2. aarch64-linux

      1. 1.8.1 multi-abi June 20, 2026 (39.7 MB)

    3. arm64-darwin

      1. 1.8.1 multi-abi June 20, 2026 (38.2 MB)

    4. x86_64-linux

      1. 1.8.1 multi-abi June 20, 2026 (41.3 MB)
  2. 1.8.0

    1. source

      1. 1.8.0 source June 18, 2026 (129 KB)

    2. aarch64-linux

      1. 1.8.0 multi-abi June 18, 2026 (39.7 MB)

    3. arm64-darwin

      1. 1.8.0 multi-abi June 18, 2026 (38.2 MB)

    4. x86_64-linux

      1. 1.8.0 multi-abi June 18, 2026 (41.3 MB)
  3. 1.8.0.pre3

    1. source

      1. 1.8.0.pre3 source June 18, 2026 (129 KB)

    2. aarch64-linux

      1. 1.8.0.pre3 multi-abi June 18, 2026 (39.7 MB)

    3. arm64-darwin

      1. 1.8.0.pre3 multi-abi June 18, 2026 (38.2 MB)

    4. x86_64-linux

      1. 1.8.0.pre3 multi-abi June 18, 2026 (41.3 MB)
  4. 1.8.0.pre2

    1. source

      1. 1.8.0.pre2 source June 18, 2026 (129 KB)

    2. arm64-darwin

      1. 1.8.0.pre2 multi-abi June 18, 2026 (38.6 MB)

    3. x86_64-linux

      1. 1.8.0.pre2 multi-abi June 18, 2026 (41.7 MB)
  5. 1.8.0.pre1

    1. source

      1. 1.8.0.pre1 source June 18, 2026 (129 KB)

    2. arm64-darwin

      1. 1.8.0.pre1 multi-abi June 18, 2026 (38.6 MB)
Show all versions (47 total)

Requirements

Rust >= 1.85

Pushed by

cpetersen

SHA 256 checksum

← Previous version