Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

dphnAI/sonar

Large-scale LLM inference engine

Owner
dphnAI (organization)
Stars
Stars: 1,899
Forks
Forks: 213
Language
Python
License
AGPL-3.0
Created
2023
Topics
api-restinference-enginemachine-learningcudainferentiarocmintelloraspeculative-decodingtpu
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos