Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

InferMatrixLab/vllm-rlt

A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages

Owner
InferMatrixLab (organization)
Stars
Stars: 214
Forks
Forks: 34
Language
Python
License
Apache-2.0
Created
2026
Topics
inference-enginellmtransformer
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos