# hkproj/pytorch-transformer-distributed

<https://repo.masters-masters.com/en/repos/hkproj/pytorch-transformer-distributed>

[Home](https://repo.masters-masters.com/en) › [hkproj](https://repo.masters-masters.com/en/owners/hkproj) › [pytorch-transformer-distributed](https://repo.masters-masters.com/en/repos/hkproj/pytorch-transformer-distributed)

hkproj/pytorch-transformer-distributed has 105 stars on GitHub. Its RepoMasters card: Prototype tier. Distributed training (multi-node) of a Transformer model

| Field | Value |
| --- | --- |
| Owner | [hkproj](https://repo.masters-masters.com/en/owners/hkproj) |
| Stars | 105 |
| Forks | 44 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | None |
| Created | 2023 |
| Topics | collective-communication, data-parallelism, deep-learning, distributed-data-parallel, distributed-training, gradient-accumulation, machine-learning, model-parallelism, pytorch, tutorial |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [hkproj/pytorch-transformer-distributed](https://github.com/hkproj/pytorch-transformer-distributed) |

## Repository

Distributed training (multi-node) of a Transformer model

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by hkproj

- [hkproj/pytorch-transformer · ★ 1,329 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/hkproj/pytorch-transformer)
- [hkproj/pytorch-stable-diffusion · ★ 1,086 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/hkproj/pytorch-stable-diffusion)
- [hkproj/pytorch-paligemma · ★ 638 · Python · Alpha](https://repo.masters-masters.com/en/repos/hkproj/pytorch-paligemma)
- [hkproj/100-days-of-gpu · ★ 452 · Alpha](https://repo.masters-masters.com/en/repos/hkproj/100-days-of-gpu)
- [hkproj/transformer-from-scratch-notes · ★ 395 · Alpha](https://repo.masters-masters.com/en/repos/hkproj/transformer-from-scratch-notes)
- [hkproj/pytorch-llama · ★ 382 · Python · Alpha](https://repo.masters-masters.com/en/repos/hkproj/pytorch-llama)

## Nearby in Python

- [ozguradmin/ahenk-turkish-tts · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/ozguradmin/ahenk-turkish-tts)
- [SuperBigFatDog/mcd-nearest-deal · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/SuperBigFatDog/mcd-nearest-deal)
- [Mosina1102/Moui · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/Mosina1102/Moui)
- [infogami/infogami · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/infogami/infogami)
- [lig/pystardict · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/lig/pystardict)
- [mattball/doxyclean · ★ 105 · Python · Prototype](https://repo.masters-masters.com/en/repos/mattball/doxyclean)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.