# yanring/Megatron-MoE-ModelZoo

<https://repo.masters-masters.com/en/repos/yanring/Megatron-MoE-ModelZoo>

[Home](https://repo.masters-masters.com/en) › [yanring](https://repo.masters-masters.com/en/owners/yanring) › [Megatron-MoE-ModelZoo](https://repo.masters-masters.com/en/repos/yanring/Megatron-MoE-ModelZoo)

yanring/Megatron-MoE-ModelZoo has 206 stars on GitHub. Its RepoMasters card: Prototype tier. Best practices for training DeepSeek, Mixtral, Qwen and other MoE…

| Field | Value |
| --- | --- |
| Owner | [yanring](https://repo.masters-masters.com/en/owners/yanring) |
| Stars | 206 |
| Forks | 35 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2025 |
| Topics | llm-training, megatron-lm, mixture-of-experts |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [yanring/Megatron-MoE-ModelZoo](https://github.com/yanring/Megatron-MoE-ModelZoo) |

## Repository

Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by yanring

- [yanring/jianzhi-Offer-Leetcode · ★ 400 · Alpha](https://repo.masters-masters.com/en/repos/yanring/jianzhi-Offer-Leetcode)

## Nearby in Python

- [iamyoki/qwen-image-2.1-skill · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/iamyoki/qwen-image-2.1-skill)
- [ashleydarosa/CC-Checker-Validator-Generator · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/ashleydarosa/CC-Checker-Validator-Generator)
- [sepehr071/iran-mcp · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/sepehr071/iran-mcp)
- [peppermintos/ice · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/peppermintos/ice)
- [PirateBox-Dev/PirateBoxScripts\_Webserver · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/PirateBox-Dev/PirateBoxScripts_Webserver)
- [kennethreitz-archive/args · ★ 206 · Python · Prototype](https://repo.masters-masters.com/en/repos/kennethreitz-archive/args)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.