Skip to content

Glossary

The words the docs use, as defined in the docs overview.

Term Meaning
Harness The client driving the model: pi, Claude Code, Cursor, an SDK app
Session One conversation or agent run; the unit of stickiness and caching
Backend A configured place models run: anthropic, bedrock, openrouter, or your own GPUs (gpu-qwen-coder)
Route One model on one backend, with its price; a model can have several
Level What a request sent with model: "auto" needs, per kind of work, 1 to 5 (coding:3); set from its wording and tools, never its length. Also called the quality floor (X-Route-Floor)
Score A model’s quality for a kind of work, 1 to 5, from published benchmarks (Epoch AI by default) or measured with meritorder eval
Headroom Spare capacity on a running GPU replica before it misses its latency target
Shadow price The internal price for self-hosted tokens: about 0 when idle, rising toward the API price as the replica fills
Rebuild cost The cost to process a session’s context again on a backend whose cache is cold
Counterfactual cost What a request would have cost on the baseline model (baseline_model, set for the organization or a team) at its API price
Ledger One row per request: who, which model and backend, tokens, cost, counterfactual cost and savings by cause; never content

From Merit-Order/meritorder at 09750a2. Merit Order is open source under the AGPL-3.0-only. Version 0.0.1, pre-production.