BetaRare
dphnAI/sonar
Large-scale LLM inference engine
- Owner
- dphnAI (organization)
- Stars
- Stars: 1,899
- Forks
- Forks: 213
- Language
- Python
- License
- AGPL-3.0
- Created
- 2023
- Topics
- api-restinference-enginemachine-learningcudainferentiarocmintelloraspeculative-decodingtpu
- Tier
- Beta (700 to 1,999 ★) What this tier means
Nearby in Python
All Python repos- Picrew/awesome-agent-harnessStars: 1,900PythonBeta
- lucidrains/byol-pytorchStars: 1,899PythonBeta
- google-deepmind/penzaiStars: 1,899PythonBeta
- ethereum/pmStars: 1,898PythonBeta
- facebookresearch/denoiserStars: 1,898PythonBeta