# EleutherAI/gpt-neox

<https://repo.masters-masters.com/en/repos/EleutherAI/gpt-neox>

[Home](https://repo.masters-masters.com/en) › [EleutherAI](https://repo.masters-masters.com/en/owners/EleutherAI) › [gpt-neox](https://repo.masters-masters.com/en/repos/EleutherAI/gpt-neox)

EleutherAI/gpt-neox has 7,473 stars on GitHub. Its RepoMasters card: Stable tier. An implementation of model parallel autoregressive transformers on GPUs…

| Field | Value |
| --- | --- |
| Owner | [EleutherAI](https://repo.masters-masters.com/en/owners/EleutherAI) |
| Stars | 7,473 |
| Forks | 1,126 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2020 |
| Topics | deepspeed-library, gpt-3, transformers, language-model |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [EleutherAI/gpt-neox](https://github.com/EleutherAI/gpt-neox) |

## Repository

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by EleutherAI

- [EleutherAI/lm-evaluation-harness · ★ 14,392 · Python · Stable](https://repo.masters-masters.com/en/repos/EleutherAI/lm-evaluation-harness)
- [EleutherAI/gpt-neo · ★ 8,252 · Python · Stable](https://repo.masters-masters.com/en/repos/EleutherAI/gpt-neo)
- [EleutherAI/pythia · ★ 2,982 · Jupyter Notebook · RC](https://repo.masters-masters.com/en/repos/EleutherAI/pythia)
- [EleutherAI/the-pile · ★ 1,679 · Python · Beta](https://repo.masters-masters.com/en/repos/EleutherAI/the-pile)
- [EleutherAI/math-lm · ★ 1,095 · Python · Beta](https://repo.masters-masters.com/en/repos/EleutherAI/math-lm)
- [EleutherAI/cookbook · ★ 857 · Python · Beta](https://repo.masters-masters.com/en/repos/EleutherAI/cookbook)

## Nearby in Python

- [apache/caldera · ★ 7,490 · Python · Stable](https://repo.masters-masters.com/en/repos/apache/caldera)
- [lining0806/PythonSpiderNotes · ★ 7,487 · Python · Stable](https://repo.masters-masters.com/en/repos/lining0806/PythonSpiderNotes)
- [WECENG/ticket-purchase · ★ 7,487 · Python · Stable](https://repo.masters-masters.com/en/repos/WECENG/ticket-purchase)
- [belluzj/fantasque-sans · ★ 7,471 · Python · Stable](https://repo.masters-masters.com/en/repos/belluzj/fantasque-sans)
- [datawhalechina/fun-rec · ★ 7,467 · Python · Stable](https://repo.masters-masters.com/en/repos/datawhalechina/fun-rec)
- [bndr/pipreqs · ★ 7,462 · Python · Stable](https://repo.masters-masters.com/en/repos/bndr/pipreqs)

---
Data: GitHub · Illustration: the project’s public image, pixelated by RepoMasters.