Logo

AI Gateways

Unified proxy servers and gateways for routing requests to multiple LLM providers

AI Gateways — comparison of litellm, langfuse, tensorzero
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
litellm
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
langfuse
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
tensorzero
Popularity
Stars56,90533,50811,721
Global Rank#393#962#4469
Weekly Activity(Aug 14 – Aug 20)
New Stars+3+10
Pushes81390
Issues Closed100
Community
Forks10,7753,613962
Contributors1,616199119
Open Issues5,007793392
Project Info
OwnerBerriAIlangfusetensorzero
LicenseNOASSERTIONNOASSERTIONApache-2.0
LanguagePythonTypeScriptRust
CreatedJul 2023May 2023Jul 2024