# runpod-workers/worker-vllm

<https://repo.masters-masters.com/en/repos/runpod-workers/worker-vllm>

[Home](https://repo.masters-masters.com/en) › [runpod-workers](https://repo.masters-masters.com/en/owners/runpod-workers) › [worker-vllm](https://repo.masters-masters.com/en/repos/runpod-workers/worker-vllm)

runpod-workers/worker-vllm has 474 stars on GitHub. Its RepoMasters card: Alpha tier. The Runpod worker template for serving our large language model…

| Field | Value |
| --- | --- |
| Owner | [runpod-workers](https://repo.masters-masters.com/en/owners/runpod-workers) |
| Stars | 474 |
| Forks | 395 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | language-model, llm, runpod, vllm |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [runpod-workers/worker-vllm](https://github.com/runpod-workers/worker-vllm) |

## Repository

The Runpod worker template for serving our large language model endpoints. Powered by vLLM.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by runpod-workers

- [runpod-workers/worker-comfyui · ★ 750 · Python · Beta](https://repo.masters-masters.com/en/repos/runpod-workers/worker-comfyui)
- [runpod-workers/worker-faster\_whisper · ★ 144 · Python · Prototype](https://repo.masters-masters.com/en/repos/runpod-workers/worker-faster_whisper)
- [runpod-workers/worker-template · ★ 136 · Python · Prototype](https://repo.masters-masters.com/en/repos/runpod-workers/worker-template)
- [runpod-workers/worker-a1111 · ★ 100 · Python · Prototype](https://repo.masters-masters.com/en/repos/runpod-workers/worker-a1111)

## Nearby in Python

- [amd/skills · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/amd/skills)
- [AI272/speaker · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/AI272/speaker)
- [ByteDance-Seed/EdgeBench · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/ByteDance-Seed/EdgeBench)
- [django-commons/django-robots · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/django-commons/django-robots)
- [py-moneyed/py-moneyed · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/py-moneyed/py-moneyed)
- [TabViewer/tabview · ★ 474 · Python · Alpha](https://repo.masters-masters.com/en/repos/TabViewer/tabview)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.