AlphaUncommon
efeslab/fiddler
[ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
- Owner
- efeslab (organization)
- Stars
- Stars: 267
- Forks
- Forks: 37
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- llmllm-inferencemixtral-8x7bmixture-of-expertslocal-inference
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by efeslab
All 4 repos by efeslab- efeslab/NanoflowStars: 976Jupyter NotebookBeta
- efeslab/AtomStars: 350CudaAlpha
- efeslab/LiteASRStars: 160PythonPrototype
Nearby in Python
All Python repos- 854875058/SymbioStars: 267PythonAlpha
- YangyangQu/research-idea-scoutStars: 267PythonAlpha
- liouhai/plot-is-all-you-needStars: 267PythonAlpha
- mnaberez/py65Stars: 267PythonAlpha
- gregs1104/pgbentStars: 267PythonAlpha
- lifelike/countersheetsextensionStars: 267PythonAlpha