Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

yanring/Megatron-MoE-ModelZoo

Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.

Owner
yanring (personal account)
Stars
Stars: 206
Forks
Forks: 35
Language
Python
License
MIT
Created
2025
Topics
llm-trainingmegatron-lmmixture-of-experts
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by yanring

All 2 repos by yanring

Nearby in Python

All Python repos