# feifeibear/LLMSpeculativeSampling

<https://repo.masters-masters.com/en/repos/feifeibear/LLMSpeculativeSampling>

[Home](https://repo.masters-masters.com/en) › [feifeibear](https://repo.masters-masters.com/en/owners/feifeibear) › [LLMSpeculativeSampling](https://repo.masters-masters.com/en/repos/feifeibear/LLMSpeculativeSampling)

feifeibear/LLMSpeculativeSampling has 927 stars on GitHub. Its RepoMasters card: Beta tier. Fast inference from large lauguage models via speculative decoding

| Field | Value |
| --- | --- |
| Owner | [feifeibear](https://repo.masters-masters.com/en/owners/feifeibear) |
| Stars | 927 |
| Forks | 97 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [feifeibear/LLMSpeculativeSampling](https://github.com/feifeibear/LLMSpeculativeSampling) |

## Repository

Fast inference from large lauguage models via speculative decoding

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by feifeibear

- [feifeibear/long-context-attention · ★ 696 · Python · Alpha](https://repo.masters-masters.com/en/repos/feifeibear/long-context-attention)
- [feifeibear/LLMRoofline · ★ 126 · Jupyter Notebook · Prototype](https://repo.masters-masters.com/en/repos/feifeibear/LLMRoofline)

## Nearby in Python

- [VAST-AI-Research/TriplaneGaussian · ★ 927 · Python · Beta](https://repo.masters-masters.com/en/repos/VAST-AI-Research/TriplaneGaussian)
- [jianzongwu/DiffSensei · ★ 927 · Python · Beta](https://repo.masters-masters.com/en/repos/jianzongwu/DiffSensei)
- [antgroup/ditto-talkinghead · ★ 927 · Python · Beta](https://repo.masters-masters.com/en/repos/antgroup/ditto-talkinghead)
- [jazzband/django-newsletter · ★ 927 · Python · Beta](https://repo.masters-masters.com/en/repos/jazzband/django-newsletter)
- [benadida/helios-server · ★ 927 · Python · Beta](https://repo.masters-masters.com/en/repos/benadida/helios-server)
- [srusskih/SublimeJEDI · ★ 927 · Python · Beta](https://repo.masters-masters.com/en/repos/srusskih/SublimeJEDI)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.