Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

gpustack/llama-box

LM inference server implementation based on *.cpp.

Archived: this repository is read-only

Owner
gpustack (organization)
Stars
Stars: 291
Forks
Forks: 29
Language
C++
License
MIT
Created
2024
Topics
openai-compatible-apicppggufdiffusiontransformer
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by gpustack

All 4 repos by gpustack

Nearby in C++

All C++ repos