# Infini-AI-Lab/MagicDec

<https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MagicDec>

[Home](https://repo.masters-masters.com/en) › [Infini-AI-Lab](https://repo.masters-masters.com/en/owners/Infini-AI-Lab) › [MagicDec](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MagicDec)

Infini-AI-Lab/MagicDec has 162 stars on GitHub. Its RepoMasters card: Prototype tier. \[ICLR2025\] Breaking Throughput-Latency Trade-off for Long Sequences with…

| Field | Value |
| --- | --- |
| Owner | [Infini-AI-Lab](https://repo.masters-masters.com/en/owners/Infini-AI-Lab) |
| Stars | 162 |
| Forks | 14 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [Infini-AI-Lab/MagicDec](https://github.com/Infini-AI-Lab/MagicDec) |

## Repository

\[ICLR2025\] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by Infini-AI-Lab

- [Infini-AI-Lab/hermit · ★ 441 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/hermit)
- [Infini-AI-Lab/Sequoia · ★ 376 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/Sequoia)
- [Infini-AI-Lab/TriForce · ★ 280 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/TriForce)
- [Infini-AI-Lab/MagicPIG · ★ 256 · Python · Alpha](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MagicPIG)
- [Infini-AI-Lab/MonarchRT · ★ 146 · Python · Prototype](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/MonarchRT)
- [Infini-AI-Lab/UMbreLLa · ★ 131 · Python · Prototype](https://repo.masters-masters.com/en/repos/Infini-AI-Lab/UMbreLLa)

## Nearby in Python

- [RCL-Robotics/SURE-map · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/RCL-Robotics/SURE-map)
- [GroundedCoreAI/nexusdesk · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/GroundedCoreAI/nexusdesk)
- [amathislab/terra · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/amathislab/terra)
- [brendano/tweetmotif · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/brendano/tweetmotif)
- [andreikop/enki · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/andreikop/enki)
- [mumrah/s3-multipart · ★ 162 · Python · Prototype](https://repo.masters-masters.com/en/repos/mumrah/s3-multipart)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.