RCEpic
algorithmicsuperintelligence/optillm
Optimizing inference proxy for LLMs
- Owner
- algorithmicsuperintelligence (organization)
- Stars
- Stars: 4,334
- Forks
- Forks: 397
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- agentagentic-aiagentic-workflowagentsapi-gatewaygenailarge-language-modelsllmllm-inferencellmapi
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by algorithmicsuperintelligence
All 2 repos by algorithmicsuperintelligence- algorithmicsuperintelligence/openevolveStars: 7,685PythonStable
Nearby in Python
All Python repos- dynaconf/dynaconfStars: 4,337PythonRC
- rytilahti/python-miioStars: 4,337PythonRC
- MorvanZhou/Tensorflow-TutorialStars: 4,335PythonRC
- yaronzz/Tidal-Media-DownloaderStars: 4,333PythonRC
- jtesta/ssh-auditStars: 4,331PythonRC
- rocky/python-uncompyle6Stars: 4,329PythonRC