Glossary
The words the docs use, as defined in the docs overview.
| Term | Meaning |
|---|---|
| Harness | The client driving the model: pi, Claude Code, Cursor, an SDK app |
| Session | One conversation or agent run; the unit of stickiness and caching |
| Backend | A configured place models run: anthropic, bedrock, openrouter, or your own GPUs (gpu-qwen-coder) |
| Route | One model on one backend, with its price; a model can have several |
| Level | What a request sent with model: "auto" needs, per kind of work, 1 to 5 (coding:3); set from its wording and tools, never its length. Also called the quality floor (X-Route-Floor) |
| Score | A model’s quality for a kind of work, 1 to 5, from published benchmarks (Epoch AI by default) or measured with meritorder eval |
| Headroom | Spare capacity on a running GPU replica before it misses its latency target |
| Shadow price | The internal price for self-hosted tokens: about 0 when idle, rising toward the API price as the replica fills |
| Rebuild cost | The cost to process a session’s context again on a backend whose cache is cold |
| Counterfactual cost | What a request would have cost on the baseline model (baseline_model, set for the organization or a team) at its API price |
| Ledger | One row per request: who, which model and backend, tokens, cost, counterfactual cost and savings by cause; never content |
From Merit-Order/meritorder at 09750a2. Merit Order is open source under the AGPL-3.0-only. Version 0.0.1, pre-production.