BetaRare
bigscience-workshop/Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
- Owner
- bigscience-workshop (organization)
- Stars
- Stars: 1,449
- Forks
- Forks: 225
- Language
- Python
- License
- None
- Created
- 2021
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by bigscience-workshop
All 8 repos by bigscience-workshop- bigscience-workshop/petalsStars: 10,678PythonStable
- bigscience-workshop/promptsourceStars: 3,042PythonRC
- bigscience-workshop/bigscienceStars: 1,020ShellBeta
- bigscience-workshop/xmtfStars: 534Jupyter NotebookAlpha
- bigscience-workshop/biomedicalStars: 507PythonAlpha
- bigscience-workshop/t-zeroStars: 463PythonAlpha
Nearby in Python
All Python repos- dleemiller/WordLlamaStars: 1,450PythonBeta
- oddcod3/Phantom-EvasionStars: 1,449PythonBeta
- keredson/gnomecastStars: 1,449PythonBeta
- bojone/attentionStars: 1,448PythonBeta
- megvii-research/ML-GCNStars: 1,448PythonBeta