Logo

AI Gateways

Unified proxy servers and gateways for routing requests to multiple LLM providers

AI Gateways — comparison of litellm, langfuse, tensorzero
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
litellm
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
langfuse
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
tensorzero
Popularity
Stars46,79127,03911,360
Global Rank#483#1273#4423
Weekly Activity(May 6 – May 12)
New Stars+88+45+6
Pushes21011710
Issues Closed1510
Community
Forks8,0042,745825
Contributors1,522156117
Open Issues3,038579383
Project Info
OwnerBerriAIlangfusetensorzero
LicenseNOASSERTIONNOASSERTIONApache-2.0
LanguagePythonTypeScriptRust
CreatedJul 2023May 2023Jul 2024