Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

guqiong96/Lsglang

Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.

Owner
guqiong96 (personal account)
Stars
Stars: 164
Forks
Forks: 22
Language
Python
License
Apache-2.0
Created
2026
Topics
cpudecodegpuhybirdinferencemodelmoenumaparallelismprefill
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by guqiong96

All 2 repos by guqiong96

Nearby in Python

All Python repos