# efeslab/fiddler

<https://repo.masters-masters.com/en/repos/efeslab/fiddler>

[Home](https://repo.masters-masters.com/en) › [efeslab](https://repo.masters-masters.com/en/owners/efeslab) › [fiddler](https://repo.masters-masters.com/en/repos/efeslab/fiddler)

efeslab/fiddler has 267 stars on GitHub. Its RepoMasters card: Alpha tier. \[ICLR'25\] Fast Inference of MoE Models with CPU-GPU Orchestration Language: Python.

| Field | Value |
| --- | --- |
| Owner | [efeslab](https://repo.masters-masters.com/en/owners/efeslab) |
| Stars | 267 |
| Forks | 37 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | llm, llm-inference, mixtral-8x7b, mixture-of-experts, local-inference |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [efeslab/fiddler](https://github.com/efeslab/fiddler) |

## Repository

\[ICLR'25\] Fast Inference of MoE Models with CPU-GPU Orchestration

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by efeslab

- [efeslab/Nanoflow · ★ 976 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/efeslab/Nanoflow)
- [efeslab/Atom · ★ 350 · Cuda · Alpha](https://repo.masters-masters.com/en/repos/efeslab/Atom)
- [efeslab/LiteASR · ★ 160 · Python · Prototype](https://repo.masters-masters.com/en/repos/efeslab/LiteASR)

## Nearby in Python

- [854875058/Symbio · ★ 267 · Python · Alpha](https://repo.masters-masters.com/en/repos/854875058/Symbio)
- [recursive-org/first-steps-toward-automated-ai-research · ★ 267 · Python · Alpha](https://repo.masters-masters.com/en/repos/recursive-org/first-steps-toward-automated-ai-research)
- [wuji-technology/wuji-ego-mint · ★ 267 · Python · Alpha](https://repo.masters-masters.com/en/repos/wuji-technology/wuji-ego-mint)
- [mnaberez/py65 · ★ 267 · Python · Alpha](https://repo.masters-masters.com/en/repos/mnaberez/py65)
- [gregs1104/pgbent · ★ 267 · Python · Alpha](https://repo.masters-masters.com/en/repos/gregs1104/pgbent)
- [lifelike/countersheetsextension · ★ 267 · Python · Alpha](https://repo.masters-masters.com/en/repos/lifelike/countersheetsextension)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.
