# romsto/Speculative-Decoding

<https://repo.masters-masters.com/en/repos/romsto/Speculative-Decoding>

[Home](https://repo.masters-masters.com/en) › [romsto](https://repo.masters-masters.com/en/owners/romsto) › [Speculative-Decoding](https://repo.masters-masters.com/en/repos/romsto/Speculative-Decoding)

romsto/Speculative-Decoding has 116 stars on GitHub. Its RepoMasters card: Prototype tier. Implementation of the paper Fast Inference from Transformers via…

| Field | Value |
| --- | --- |
| Owner | [romsto](https://repo.masters-masters.com/en/owners/romsto) |
| Stars | 116 |
| Forks | 25 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | fast-inference, llm, llm-inference, llm-optimization, speculative-decoding |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [romsto/Speculative-Decoding](https://github.com/romsto/Speculative-Decoding) |

## Repository

Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## Nearby in Python

- [ukr8b3g-cmyk/MOSS-Image-Character-Catalog · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/ukr8b3g-cmyk/MOSS-Image-Character-Catalog)
- [flemuh/radar-public-sector · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/flemuh/radar-public-sector)
- [Sac-Y/match-cut · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/Sac-Y/match-cut)
- [jezdez/django-mobileadmin · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/jezdez/django-mobileadmin)
- [montylounge/django-sugar · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/montylounge/django-sugar)
- [codysoyland/django-template-repl · ★ 116 · Python · Prototype](https://repo.masters-masters.com/en/repos/codysoyland/django-template-repl)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.