What health metrics mean
A “success” means the upstream vendor returned a valid completion response. Errors caused by invalid prompts or context-length violations are counted separately.
Platform-wide stats
Across all models and providers, Flatkey achieves:- 99.9% average 30-day success rate — measured on production traffic
- Automatic failover — when a provider endpoint degrades, Flatkey routes to a healthy alternative
- Live dashboards — health data refreshed daily from real traffic
Top models by usage (recent)
The following models have the highest traffic volume on the Flatkey platform:
This leaderboard updates daily. See the full live ranking at flatkey.ai/rankings.
How to use health data
When choosing a model for production:- Prefer high success-rate models for reliability-sensitive workloads.
- Check average latency for real-time or streaming applications where time-to-first-token matters.
- Monitor your own usage in the Usage dashboard — filter by model to see your success rate.
Failover behavior
Flatkey monitors upstream provider health continuously. When a provider returns elevated error rates or latency spikes:- Requests are automatically retried on a healthy provider endpoint.
- Your client receives a valid response without needing to implement retry logic.
- The failover is transparent — you see a successful response, not an error.
Viewing live health data
Real-time model health, latency rankings, and volume data are available at:- flatkey.ai/rankings — full leaderboard with token volume and share
- flatkey.ai/models — per-model health alongside pricing