red-candle 1.7.0
Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
Gemfile:
=
install:
=
Development Dependencies (11):
Requirements:
Rust >= 1.85