# gordicaleksa/pytorch-original-transformer

<https://repo.masters-masters.com/en/repos/gordicaleksa/pytorch-original-transformer>

[Home](https://repo.masters-masters.com/en) › [gordicaleksa](https://repo.masters-masters.com/en/owners/gordicaleksa) › [pytorch-original-transformer](https://repo.masters-masters.com/en/repos/gordicaleksa/pytorch-original-transformer)

gordicaleksa/pytorch-original-transformer has 1,119 stars on GitHub. Its RepoMasters card: Beta tier. My implementation of the original transformer model…

| Field | Value |
| --- | --- |
| Owner | [gordicaleksa](https://repo.masters-masters.com/en/owners/gordicaleksa) |
| Stars | 1,119 |
| Forks | 188 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | MIT |
| Created | 2020 |
| Topics | transformer, transformers, pytorch-transformer, pytorch-transformers, attention, attention-mechanism, attention-is-all-you-need, pytorch, python, jupyter |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [gordicaleksa/pytorch-original-transformer](https://github.com/gordicaleksa/pytorch-original-transformer) |

## Repository

My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by gordicaleksa

- [gordicaleksa/pytorch-GAT · ★ 2,691 · Jupyter Notebook · RC](https://repo.masters-masters.com/en/repos/gordicaleksa/pytorch-GAT)
- [gordicaleksa/get-started-with-JAX · ★ 790 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/gordicaleksa/get-started-with-JAX)
- [gordicaleksa/Open-NLLB · ★ 488 · Python · Alpha](https://repo.masters-masters.com/en/repos/gordicaleksa/Open-NLLB)
- [gordicaleksa/pytorch-neural-style-transfer · ★ 455 · Python · Alpha](https://repo.masters-masters.com/en/repos/gordicaleksa/pytorch-neural-style-transfer)
- [gordicaleksa/pytorch-deepdream · ★ 402 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/gordicaleksa/pytorch-deepdream)
- [gordicaleksa/pytorch-GANs · ★ 391 · Python · Alpha](https://repo.masters-masters.com/en/repos/gordicaleksa/pytorch-GANs)

## Nearby in Jupyter Notebook

- [datawhalechina/base-llm · ★ 1,122 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/datawhalechina/base-llm)
- [rasbt/LLM-workshop-2024 · ★ 1,121 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/rasbt/LLM-workshop-2024)
- [LangChain-OpenTutorial/LangChain-OpenTutorial · ★ 1,121 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/LangChain-OpenTutorial/LangChain-OpenTutorial)
- [atilsamancioglu/P01-PythonBootcampNotebooks · ★ 1,118 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/atilsamancioglu/P01-PythonBootcampNotebooks)
- [Harmonai-org/sample-generator · ★ 1,116 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/Harmonai-org/sample-generator)
- [yzslab/gaussian-splatting-lightning · ★ 1,116 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/yzslab/gaussian-splatting-lightning)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.