Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

powerserve-project/PowerServe

High-speed and easy-use LLM serving framework for local deployment

Owner
powerserve-project (organization)
Stars
Stars: 167
Forks
Forks: 22
Language
C++
License
Apache-2.0
Created
2025
Topics
llamallmllm-inferencellm-servingnpuqwensmartphonesmallthinker
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in C++

All C++ repos