completion-kit 0.1.0
CompletionKit is a prompt testing platform that runs as a Rails engine or a standalone app. Run prompts against real datasets, score every output with an LLM judge against criteria you define, track prompt versions, and get AI-generated improvement suggestions grounded in your actual results. Includes a web UI, REST API, and a built-in MCP server with 36 tools.
Gemfile:
=
install:
=
Runtime Dependencies (9):
bootstrap
~> 5.2
csv
~> 3.2
faraday
~> 2.7
faraday-retry
~> 2.0
heroicons-rails
~> 1.2
jquery-rails
~> 4.5
rails
>= 7.0.0, < 9.0.0
sassc-rails
~> 2.1
turbo-rails
>= 1.5