Measured performance
Provider & model performance
Measured time-to-first-token, time-to-first-byte, effective throughput, and uptime for every LLM provider and model TrustedRouter routes to — continuously sampled, not vendor-claimed.
Last updated
2026-08-01T19:17:19Z
Continuously sampled from TrustedRouter's monitor regions using a
rolling benchmark set of up to 10,000 samples. Time-to-first-token (TTFT),
time-to-first-byte (TTFB), effective throughput, and success rate come from real
streaming requests, not vendor claims. Completion rate shows the end-user result.
Provider availability excludes failures owned by TrustedRouter, customers, or route
configuration, while still reporting those failures under their actual owner.
Capacity acceptance measures requests not rejected for provider overload. Effective throughput is provider-reported
output tokens divided by complete request time, so buffered delivery cannot inflate
the result. Unsupported route and probe-configuration rows are reported separately
and do not count as provider downtime. No prompt or output content is ever stored.
Providers
Ranked by provider-attributed availability, then p50 time-to-first-token across all of a provider's models (2 providers · 2 availability samples · 0 sustained throughput samples). Providers below the evidence floor remain visible as warming, but do not receive a rank.
| # | Provider | Models | Completion | Provider availability | Within deadline | Capacity accepted | p50 TTFT | p95 TTFT | Effective throughput | Failure owner | Config excluded | Samples |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| — | acme-cea06d43ef94 warming | 1 | 100.00% | 100.00% | 0.00% | 100.00% | — | — | — | — | — | 1 |
| — | other-cea06d43ef94 warming | 1 | 100.00% | 100.00% | 0.00% | 100.00% | — | — | — | — | — | 1 |
Models
Qualified models are ranked by provider-attributed availability, then p50 TTFT. Thin availability and throughput measurements stay visible below the ranked set as warming.
| # | Model | Provider | Completion | Provider availability | Within deadline | Capacity accepted | p50 TTFT | p95 TTFT | p50 TTFB | p95 TTFB | Effective throughput | Config excluded | Samples |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| — | acme-cea06d43ef94/m1 warming | acme-cea06d43ef94 | 100.00% | 100.00% | 0.00% 20s | 100.00% | — | — | — | — | — | — | 1 |
| — | other-cea06d43ef94/m2 warming | other-cea06d43ef94 | 100.00% | 100.00% | 0.00% 20s | 100.00% | — | — | — | — | — | — | 1 |