PrototypeCommon
hkproj/pytorch-transformer-distributed
Distributed training (multi-node) of a Transformer model
- Owner
- hkproj (personal account)
- Stars
- Stars: 105
- Forks
- Forks: 44
- Language
- Python
- License
- None
- Created
- 2023
- Topics
- collective-communicationdata-parallelismdeep-learningdistributed-data-paralleldistributed-traininggradient-accumulationmachine-learningmodel-parallelismpytorchtutorial
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by hkproj
All 13 repos by hkproj- hkproj/pytorch-transformerStars: 1,329Jupyter NotebookBeta
- hkproj/pytorch-stable-diffusionStars: 1,086Jupyter NotebookBeta
- hkproj/pytorch-paligemmaStars: 638PythonAlpha
- hkproj/100-days-of-gpuStars: 452Alpha
- hkproj/transformer-from-scratch-notesStars: 395Alpha
- hkproj/pytorch-llamaStars: 382PythonAlpha
Nearby in Python
All Python repos- ozguradmin/ahenk-turkish-ttsStars: 105PythonPrototype
- h0ll0w-AkuZr0guY/MiaoTaskStars: 105PythonPrototype
- SuperBigFatDog/mcd-nearest-dealStars: 105PythonPrototype
- infogami/infogamiStars: 105PythonPrototype
- lig/pystardictStars: 105PythonPrototype
- mattball/doxycleanStars: 105PythonPrototype