LiteLLM
Manage authentication, load balancing, and cost tracking across 100+ LLMs through a single OpenAI-compatible gateway. Trusted by Netflix and enterprise teams.
45,416
Unknown
Alternative to: Cloudflare AI Gateway
BackPage 1 of 1
Best alternative software
Best Open Source Cloudflare AI Gateway Alternatives
Route, monitor, and control API requests to multiple AI models through a unified gateway with built-in caching, rate limiting, and detailed analytics for cost optimization.
Cloudflare AI Gateway5 tools
Open-source tools
Showing 5 of 5 curated projects from this topic.
Portkey AI Gateway
Comprehensive AI platform with gateway, observability, guardrails, and prompt management. Access 1,600+ LLMs via unified API with enterprise-grade security.
11,544
MIT
Alternative to: Cloudflare AI Gateway
Bifrost
Open-source AI gateway delivering 50x faster performance than alternatives. Access 1000+ models from 8+ providers with built-in governance, fallback, and observability.
4,501
Apache-2.0
Alternative to: Cloudflare AI Gateway
Envoy AI Gateway
Open source gateway built on Envoy for routing application traffic to GenAI services. Supports 16+ LLM providers including OpenAI, Anthropic, AWS Bedrock.
1,572
Apache-2.0
Alternative to: Cloudflare AI Gateway
LLM Gateway
Route, manage, and analyze LLM requests across multiple providers with one API. Compatible with OpenAI format, includes usage analytics and performance monitoring.
1,165
MIT
Alternative to: Cloudflare AI Gateway