Logo

AI Gateways

Unified proxy servers and gateways for routing requests to multiple LLM providers

AI Gateways — comparison of litellm, langfuse, tensorzero
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
litellm
🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
langfuse
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
tensorzero
Popularity
Stars60,87835,60011,709
Global Rank#367#920#4584
Weekly Activity(Oct 3 – Oct 9)
New Stars+771+281+1
Pushes2721010
Issues Closed720
Community
Forks12,2093,962973
Contributors1,787221119
Open Issues5,4571,024392
Project Info
OwnerBerriAIlangfusetensorzero
LicenseNOASSERTIONNOASSERTIONApache-2.0
LanguagePythonTypeScriptRust
CreatedJul 2023May 2023Jul 2024