Illustration: the project’s public image, pixelated by RepoMasters. Credits
BetaRare

vllm-project/speculators

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

Owner
vllm-project (organization)
Stars
Stars: 938
Forks
Forks: 278
Language
Python
License
Apache-2.0
Created
2025
Topics
speculative-decoding
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by vllm-project

All 20 repos by vllm-project

Nearby in Python

All Python repos