# EfficientMoE/MoE-Infinity

<https://repo.masters-masters.com/en/repos/EfficientMoE/MoE-Infinity>

[Home](https://repo.masters-masters.com/en) › [EfficientMoE](https://repo.masters-masters.com/en/owners/EfficientMoE) › [MoE-Infinity](https://repo.masters-masters.com/en/repos/EfficientMoE/MoE-Infinity)

EfficientMoE/MoE-Infinity has 379 stars on GitHub. Its RepoMasters card: Alpha tier. PyTorch library for cost-effective, fast and easy serving of MoE models.

| Field | Value |
| --- | --- |
| Owner | [EfficientMoE](https://repo.masters-masters.com/en/owners/EfficientMoE) |
| Stars | 379 |
| Forks | 48 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2024 |
| Topics | inference-engine, large-language-models, mixture-of-experts, huggingface, pytorch, llm-inference |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [EfficientMoE/MoE-Infinity](https://github.com/EfficientMoE/MoE-Infinity) |

## Repository

PyTorch library for cost-effective, fast and easy serving of MoE models.

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Python

- [monarchjuno/tradingcodex · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/monarchjuno/tradingcodex)
- [Sallyn0225/eidolon-sc · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/Sallyn0225/eidolon-sc)
- [arnaldolima1/gow-ascension-pc · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/arnaldolima1/gow-ascension-pc)
- [disqus/nydus · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/disqus/nydus)
- [adriank/ObjectPath · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/adriank/ObjectPath)
- [princehaku/pyrailgun · ★ 379 · Python · Alpha](https://repo.masters-masters.com/en/repos/princehaku/pyrailgun)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.