# guqiong96/Lvllm

<https://repo.masters-masters.com/en/repos/guqiong96/Lvllm>

[Home](https://repo.masters-masters.com/en) › [guqiong96](https://repo.masters-masters.com/en/owners/guqiong96) › [Lvllm](https://repo.masters-masters.com/en/repos/guqiong96/Lvllm)

guqiong96/Lvllm has 474 stars on GitHub. Its RepoMasters card: Alpha tier. LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory…

| Field | Value |
| --- | --- |
| Owner | [guqiong96](https://repo.masters-masters.com/en/owners/guqiong96) |
| Stars | 474 |
| Forks | 42 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2025 |
| Topics | hybrid, inference, model, moe, numa, parallelism, vllm, cpu, decode, gpu |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [guqiong96/Lvllm](https://github.com/guqiong96/Lvllm) |

## Repository

LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features an efficient GPU parallel and NUMA parallel architecture, supporting hybrid inference for MOE large models.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by guqiong96

- [guqiong96/Lsglang · ★ 164 · Python · Prototype](https://repo.masters-masters.com/en/repos/guqiong96/Lsglang)

## Nearby in Python

- [QuZhan51496/paper2anything · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/QuZhan51496/paper2anything)
- [ByteDance-Seed/EdgeBench · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/ByteDance-Seed/EdgeBench)
- [chengmarc/minecraft-citygen · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/chengmarc/minecraft-citygen)
- [django-commons/django-robots · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/django-commons/django-robots)
- [py-moneyed/py-moneyed · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/py-moneyed/py-moneyed)
- [TabViewer/tabview · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/TabViewer/tabview)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.