# FMInference/FlexLLMGen

<https://repo.masters-masters.com/en/repos/FMInference/FlexLLMGen>

[Home](https://repo.masters-masters.com/en) › [FMInference](https://repo.masters-masters.com/en/owners/FMInference) › [FlexLLMGen](https://repo.masters-masters.com/en/repos/FMInference/FlexLLMGen)

FMInference/FlexLLMGen has 9,343 stars on GitHub. Its RepoMasters card: Stable tier. Running large language models on a single GPU for throughput-oriented…

| Field | Value |
| --- | --- |
| Owner | [FMInference](https://repo.masters-masters.com/en/owners/FMInference) |
| Stars | 9,343 |
| Forks | 587 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | deep-learning, gpt-3, high-throughput, large-language-models, machine-learning, offloading, opt |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [FMInference/FlexLLMGen](https://github.com/FMInference/FlexLLMGen) |

## Repository

Running large language models on a single GPU for throughput-oriented scenarios.

Archived: this repository is read-only

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by FMInference

- [FMInference/H2O · ★ 537 · Python · Alpha](https://repo.masters-masters.com/en/repos/FMInference/H2O)
- [FMInference/DejaVu · ★ 363 · Python · Alpha](https://repo.masters-masters.com/en/repos/FMInference/DejaVu)

## Nearby in Python

- [facebookresearch/maskrcnn-benchmark · ★ 9,360 · Python · Stable](https://repo.masters-masters.com/en/repos/facebookresearch/maskrcnn-benchmark)
- [garrettj403/SciencePlots · ★ 9,357 · Python · Stable](https://repo.masters-masters.com/en/repos/garrettj403/SciencePlots)
- [X-PLUG/MobileAgent · ★ 9,350 · Python · Stable](https://repo.masters-masters.com/en/repos/X-PLUG/MobileAgent)
- [keras-team/autokeras · ★ 9,340 · Python · Stable](https://repo.masters-masters.com/en/repos/keras-team/autokeras)
- [voicepaw/so-vits-svc-fork · ★ 9,331 · Python · Stable](https://repo.masters-masters.com/en/repos/voicepaw/so-vits-svc-fork)
- [meituan-longcat/LongCat-Video · ★ 9,326 · Python · Stable](https://repo.masters-masters.com/en/repos/meituan-longcat/LongCat-Video)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.