Illustration: the project’s public image, pixelated by RepoMasters. Credits
LTSLegendary

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Owner
BerriAI (organization)
Stars
Stars: 62,515
Forks
Forks: 12,916
Language
Python
License
None
Created
2023
Topics
anthropiclangchainllmllmopsopenaiai-gatewayazure-openaibedrockgatewayopenai-proxy
Tier
LTS (20,000 ★ and up) What this tier means
View on GitHub

More repos by BerriAI

All 6 repos by BerriAI

Nearby in Python

All Python repos