# VectorInstitute/vector-inference

<https://repo.masters-masters.com/en/repos/VectorInstitute/vector-inference>

[Home](https://repo.masters-masters.com/en) › [VectorInstitute](https://repo.masters-masters.com/en/owners/VectorInstitute) › [vector-inference](https://repo.masters-masters.com/en/repos/VectorInstitute/vector-inference)

VectorInstitute/vector-inference has 110 stars on GitHub. Its RepoMasters card: Prototype tier. Efficient LLM inference on Slurm clusters. Language: Python.

| Field | Value |
| --- | --- |
| Owner | [VectorInstitute](https://repo.masters-masters.com/en/owners/VectorInstitute) |
| Stars | 110 |
| Forks | 14 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | inference, text-embedding, vllm, vlm, llm-infernece, llm-infrastructure, multimodal, reward-model, sglang, audio-transcription |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [VectorInstitute/vector-inference](https://github.com/VectorInstitute/vector-inference) |

## Repository

Efficient LLM inference on Slurm clusters.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by VectorInstitute

- [VectorInstitute/fed-rag · ★ 150 · Python · Prototype](https://repo.masters-masters.com/en/repos/VectorInstitute/fed-rag)

## Nearby in Python

- [charolettebradford1361985svo-bit/stable-sprite-animation · ★ 110 · Python · Prototype](https://repo.masters-masters.com/en/repos/charolettebradford1361985svo-bit/stable-sprite-animation)
- [Sac-Y/match-cut · ★ 110 · Python · Prototype](https://repo.masters-masters.com/en/repos/Sac-Y/match-cut)
- [a55uka/nup · ★ 110 · Python · Prototype](https://repo.masters-masters.com/en/repos/a55uka/nup)
- [turian/textSNE · ★ 110 · Python · Prototype](https://repo.masters-masters.com/en/repos/turian/textSNE)
- [denied/denied · ★ 110 · Python · Prototype](https://repo.masters-masters.com/en/repos/denied/denied)
- [eagleflo/mpyq · ★ 110 · Python · Prototype](https://repo.masters-masters.com/en/repos/eagleflo/mpyq)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.