RCEpic
FasterDecoding/Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
- Owner
- FasterDecoding (organization)
- Stars
- Stars: 2,774
- Forks
- Forks: 206
- Language
- Jupyter Notebook
- License
- Apache-2.0
- Created
- 2023
- Topics
- llmllm-inference
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by FasterDecoding
All 5 repos by FasterDecoding- FasterDecoding/SnapKVStars: 336PythonAlpha
- FasterDecoding/RESTStars: 220CPrototype
- FasterDecoding/BitDeltaStars: 207Jupyter NotebookPrototype
- FasterDecoding/TEALStars: 173PythonPrototype
Nearby in Jupyter Notebook
All Jupyter Notebook repos- imanoop7/Ollama-OCRStars: 2,786Jupyter NotebookRC
- Visualize-ML/Book6_First-Course-in-Data-ScienceStars: 2,785Jupyter NotebookRC
- FurkanGozukara/Stable-DiffusionStars: 2,780Jupyter NotebookRC
- FranxYao/chain-of-thought-hubStars: 2,773Jupyter NotebookRC
- AllenDowney/ThinkPythonStars: 2,766Jupyter NotebookRC
- huggingface/cookbookStars: 2,758Jupyter NotebookRC