AlphaUncommon
EfficientMoE/MoE-Infinity
PyTorch library for cost-effective, fast and easy serving of MoE models.
- Owner
- EfficientMoE (organization)
- Stars
- Stars: 377
- Forks
- Forks: 48
- Language
- Python
- License
- Apache-2.0
- Created
- 2024
- Topics
- inference-enginelarge-language-modelsmixture-of-expertshuggingfacepytorchllm-inference
- Tier
- Alpha (250 to 699 ★) What this tier means
Nearby in Python
All Python repos- humanfia/humanizeStars: 377PythonAlpha
- songshikang0111/awesome-REA-casesStars: 377PythonAlpha
- reacher-z/Awesome-CUAStars: 377PythonAlpha
- kragen/xcomposeStars: 377PythonAlpha
- sbp/phennyStars: 377PythonAlpha
- vstinner/pysandboxStars: 377PythonAlpha