# NVIDIA/Megatron-LM

<https://repo.masters-masters.com/en/repos/NVIDIA/Megatron-LM>

[Home](https://repo.masters-masters.com/en) › [NVIDIA](https://repo.masters-masters.com/en/owners/NVIDIA) › [Megatron-LM](https://repo.masters-masters.com/en/repos/NVIDIA/Megatron-LM)

NVIDIA/Megatron-LM has 18,318 stars on GitHub. Its RepoMasters card: Stable tier. Ongoing research training transformer models at scale Language: Python.

| Field | Value |
| --- | --- |
| Owner | [NVIDIA](https://repo.masters-masters.com/en/owners/NVIDIA) |
| Stars | 18,318 |
| Forks | 4,699 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2019 |
| Topics | large-language-models, model-para, transformers |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [NVIDIA/Megatron-LM](https://github.com/NVIDIA/Megatron-LM) |

## Repository

Ongoing research training transformer models at scale

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by NVIDIA

- [NVIDIA/SkillSpector · ★ 24,064 · Python · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/SkillSpector)
- [NVIDIA/NemoClaw · ★ 22,922 · TypeScript · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/NemoClaw)
- [NVIDIA/OpenShell · ★ 21,000 · Rust · LTS](https://repo.masters-masters.com/en/repos/NVIDIA/OpenShell)
- [NVIDIA/nvidia-docker · ★ 17,607 · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/nvidia-docker)
- [NVIDIA/open-gpu-kernel-modules · ★ 17,544 · C · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/open-gpu-kernel-modules)
- [NVIDIA/TensorRT-LLM · ★ 14,995 · Python · Stable](https://repo.masters-masters.com/en/repos/NVIDIA/TensorRT-LLM)

## Nearby in Python

- [xming521/WeClone · ★ 18,343 · Python · Stable](https://repo.masters-masters.com/en/repos/xming521/WeClone)
- [Wan-Video/Wan2.2 · ★ 18,334 · Python · Stable](https://repo.masters-masters.com/en/repos/Wan-Video/Wan2.2)
- [emcie-co/parlant · ★ 18,318 · Python · Stable](https://repo.masters-masters.com/en/repos/emcie-co/parlant)
- [muratcankoylan/Agent-Skills-for-Context-Engineering · ★ 18,290 · Python · Stable](https://repo.masters-masters.com/en/repos/muratcankoylan/Agent-Skills-for-Context-Engineering)
- [laramies/theHarvester · ★ 18,216 · Python · Stable](https://repo.masters-masters.com/en/repos/laramies/theHarvester)
- [sczhou/CodeFormer · ★ 18,208 · Python · Stable](https://repo.masters-masters.com/en/repos/sczhou/CodeFormer)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.