Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

InftyAI/llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

Owner
InftyAI (organization)
Stars
Stars: 315
Forks
Forks: 48
Language
Go
License
Apache-2.0
Created
2023
Topics
kubernetesllmllamacppsglangvllmtext-generation-inferencehuggingfacemodelscopeollamainference
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by InftyAI

All 2 repos by InftyAI

Nearby in Go

All Go repos