StableVery rare
FMInference/FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
Archived: this repository is read-only
- Owner
- FMInference (organization)
- Stars
- Stars: 9,343
- Forks
- Forks: 587
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- deep-learninggpt-3high-throughputlarge-language-modelsmachine-learningoffloadingopt
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by FMInference
All 3 repos by FMInference- FMInference/H2OStars: 537PythonAlpha
- FMInference/DejaVuStars: 363PythonAlpha
Nearby in Python
All Python repos- facebookresearch/maskrcnn-benchmarkStars: 9,360PythonStable
- garrettj403/SciencePlotsStars: 9,355PythonStable
- X-PLUG/MobileAgentStars: 9,348PythonStable
- keras-team/autokerasStars: 9,340PythonStable
- voicepaw/so-vits-svc-forkStars: 9,331PythonStable
- meituan-longcat/LongCat-VideoStars: 9,320PythonStable