# vllm-project/vllm

<https://repo.masters-masters.com/en/repos/vllm-project/vllm>

[Home](https://repo.masters-masters.com/en) › [vllm-project](https://repo.masters-masters.com/en/owners/vllm-project) › [vllm](https://repo.masters-masters.com/en/repos/vllm-project/vllm)

vllm-project/vllm has 96,265 stars on GitHub. Its RepoMasters card: LTS tier. A high-throughput and memory-efficient inference and serving engine for LLMs

| Field | Value |
| --- | --- |
| Owner | [vllm-project](https://repo.masters-masters.com/en/owners/vllm-project) |
| Stars | 96,265 |
| Forks | 24,385 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | gpt, llm, pytorch, model-serving, transformer, llm-serving, inference, llama, amd, cuda |
| Tier | [LTS (20,000 ★ and up)](https://repo.masters-masters.com/en/ranks/masterpiece) |
| View on GitHub | [vllm-project/vllm](https://github.com/vllm-project/vllm) |

## Repository

A high-throughput and memory-efficient inference and serving engine for LLMs

The tier for repos with 20,000 ★ and up. Published odds per card pulled: 0.1%. Rarity: Legendary.

## More repos by vllm-project

- [vllm-project/vllm-omni · ★ 7,521 · Python · Stable](https://repo.masters-masters.com/en/repos/vllm-project/vllm-omni)
- [vllm-project/semantic-router · ★ 6,390 · Go · Stable](https://repo.masters-masters.com/en/repos/vllm-project/semantic-router)
- [vllm-project/aibrix · ★ 5,179 · Go · Stable](https://repo.masters-masters.com/en/repos/vllm-project/aibrix)
- [vllm-project/llm-compressor · ★ 3,944 · Python · RC](https://repo.masters-masters.com/en/repos/vllm-project/llm-compressor)
- [vllm-project/vllm-ascend · ★ 3,045 · Python · RC](https://repo.masters-masters.com/en/repos/vllm-project/vllm-ascend)
- [vllm-project/production-stack · ★ 2,707 · Python · RC](https://repo.masters-masters.com/en/repos/vllm-project/production-stack)

## Nearby in Python

- [karpathy/autoresearch · ★ 99,200 · Python · LTS](https://repo.masters-masters.com/en/repos/karpathy/autoresearch)
- [nvbn/thefuck · ★ 97,943 · Python · LTS](https://repo.masters-masters.com/en/repos/nvbn/thefuck)
- [hacksider/Deep-Live-Cam · ★ 97,609 · Python · LTS](https://repo.masters-masters.com/en/repos/hacksider/Deep-Live-Cam)
- [3b1b/manim · ★ 96,098 · Python · LTS](https://repo.masters-masters.com/en/repos/3b1b/manim)
- [sherlock-project/sherlock · ★ 95,526 · Python · LTS](https://repo.masters-masters.com/en/repos/sherlock-project/sherlock)
- [D4Vinci/Scrapling · ★ 95,309 · Python · LTS](https://repo.masters-masters.com/en/repos/D4Vinci/Scrapling)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.