PrototypeCommon
VectorInstitute/vector-inference
Efficient LLM inference on Slurm clusters.
- Owner
- VectorInstitute (organization)
- Stars
- Stars: 110
- Forks
- Forks: 14
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- inferencetext-embeddingvllmvlmllm-infernecellm-infrastructuremultimodalreward-modelsglangaudio-transcription
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by VectorInstitute
All 2 repos by VectorInstitute- VectorInstitute/fed-ragStars: 150PythonPrototype
Nearby in Python
All Python repos- YvanQian/mcd-catering-officerStars: 110PythonPrototype
- CH-LaTiao/lumina-guideStars: 110PythonPrototype
- BlueKnightNet/Blue-Knight-Proxy-BotHostingStars: 110PythonPrototype
- turian/textSNEStars: 110PythonPrototype
- denied/deniedStars: 110PythonPrototype
- eagleflo/mpyqStars: 110PythonPrototype