PrototypeCommon
Infini-AI-Lab/MagicDec
[ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
- Owner
- Infini-AI-Lab (organization)
- Stars
- Stars: 162
- Forks
- Forks: 14
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by Infini-AI-Lab
All 9 repos by Infini-AI-Lab- Infini-AI-Lab/hermitStars: 435PythonAlpha
- Infini-AI-Lab/SequoiaStars: 376PythonAlpha
- Infini-AI-Lab/TriForceStars: 280PythonAlpha
- Infini-AI-Lab/MagicPIGStars: 256PythonAlpha
- Infini-AI-Lab/MonarchRTStars: 146PythonPrototype
- Infini-AI-Lab/UMbreLLaStars: 131PythonPrototype
Nearby in Python
All Python repos- neurwerk/k8s_stack_baseStars: 162PythonPrototype
- RCL-Robotics/SURE-mapStars: 162PythonPrototype
- PandaSI-Labs/pandasi-agentStars: 162PythonPrototype
- brendano/tweetmotifStars: 162PythonPrototype
- andreikop/enkiStars: 162PythonPrototype
- kvh/Python-Suffix-TreeStars: 162PythonPrototype