llm_bench 0.3.1
LLM Bench is a Ruby gem that allows you to benchmark and compare the performance of different Large Language Model providers and APIs. It supports both OpenAI and Anthropic-compatible API formats, provides parallel execution, and includes continuous tracking capabilities with CSV export.
Gemfile:
=
install:
=
Runtime Dependencies (1):
colorize
~> 1.1