# hao-ai-lab/LookaheadDecoding

<https://repo.masters-masters.com/en/repos/hao-ai-lab/LookaheadDecoding>

[Home](https://repo.masters-masters.com/en) › [hao-ai-lab](https://repo.masters-masters.com/en/owners/hao-ai-lab) › [LookaheadDecoding](https://repo.masters-masters.com/en/repos/hao-ai-lab/LookaheadDecoding)

hao-ai-lab/LookaheadDecoding has 1,346 stars on GitHub. Its RepoMasters card: Beta tier. \[ICML 2024\] Break the Sequential Dependency of LLM Inference Using…

| Field | Value |
| --- | --- |
| Owner | [hao-ai-lab](https://repo.masters-masters.com/en/owners/hao-ai-lab) |
| Stars | 1,346 |
| Forks | 84 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [hao-ai-lab/LookaheadDecoding](https://github.com/hao-ai-lab/LookaheadDecoding) |

## Repository

\[ICML 2024\] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by hao-ai-lab

- [hao-ai-lab/FastVideo · ★ 4,769 · Python · RC](https://repo.masters-masters.com/en/repos/hao-ai-lab/FastVideo)
- [hao-ai-lab/Consistency\_LLM · ★ 418 · Python · Alpha](https://repo.masters-masters.com/en/repos/hao-ai-lab/Consistency_LLM)
- [hao-ai-lab/JetSpec · ★ 254 · Python · Alpha](https://repo.masters-masters.com/en/repos/hao-ai-lab/JetSpec)
- [hao-ai-lab/Dynasor · ★ 235 · Python · Prototype](https://repo.masters-masters.com/en/repos/hao-ai-lab/Dynasor)
- [hao-ai-lab/d3LLM · ★ 157 · Python · Prototype](https://repo.masters-masters.com/en/repos/hao-ai-lab/d3LLM)
- [hao-ai-lab/JacobiForcing · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/hao-ai-lab/JacobiForcing)

## Nearby in Python

- [Data-Learn/data-engineering · ★ 1,347 · Python · Beta](https://repo.masters-masters.com/en/repos/Data-Learn/data-engineering)
- [BytedTsinghua-SIA/CUDA-Agent · ★ 1,347 · Python · Beta](https://repo.masters-masters.com/en/repos/BytedTsinghua-SIA/CUDA-Agent)
- [jeffzh3ng/fuxi · ★ 1,346 · Python · Beta](https://repo.masters-masters.com/en/repos/jeffzh3ng/fuxi)
- [platomav/MEAnalyzer · ★ 1,345 · Python · Beta](https://repo.masters-masters.com/en/repos/platomav/MEAnalyzer)
- [mariostoev/finviz · ★ 1,345 · Python · Beta](https://repo.masters-masters.com/en/repos/mariostoev/finviz)
- [ToanTech/py-apple-quadruped-robot · ★ 1,345 · Python · Beta](https://repo.masters-masters.com/en/repos/ToanTech/py-apple-quadruped-robot)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.