# lucidrains/electra-pytorch

<https://repo.masters-masters.com/en/repos/lucidrains/electra-pytorch>

[Home](https://repo.masters-masters.com/en) › [lucidrains](https://repo.masters-masters.com/en/owners/lucidrains) › [electra-pytorch](https://repo.masters-masters.com/en/repos/lucidrains/electra-pytorch)

lucidrains/electra-pytorch has 237 stars on GitHub. Its RepoMasters card: Prototype tier. A simple and working implementation of Electra, the fastest way to…

| Field | Value |
| --- | --- |
| Owner | [lucidrains](https://repo.masters-masters.com/en/owners/lucidrains) |
| Stars | 237 |
| Forks | 46 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2020 |
| Topics | artificial-intelligence, deep-learning, pre-training, transformer |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [lucidrains/electra-pytorch](https://github.com/lucidrains/electra-pytorch) |

## Repository

A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by lucidrains

- [lucidrains/vit-pytorch · ★ 25,555 · Python · LTS](https://repo.masters-masters.com/en/repos/lucidrains/vit-pytorch)
- [lucidrains/DALLE2-pytorch · ★ 11,306 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/DALLE2-pytorch)
- [lucidrains/denoising-diffusion-pytorch · ★ 10,723 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/denoising-diffusion-pytorch)
- [lucidrains/imagen-pytorch · ★ 8,430 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/imagen-pytorch)
- [lucidrains/PaLM-rlhf-pytorch · ★ 7,862 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/PaLM-rlhf-pytorch)
- [lucidrains/x-transformers · ★ 5,962 · Python · Stable](https://repo.masters-masters.com/en/repos/lucidrains/x-transformers)

## Nearby in Python

- [Hyacehila/humanizer-zh-next · ★ 237 · Python · Prototype](https://repo.masters-masters.com/en/repos/Hyacehila/humanizer-zh-next)
- [LYiHub/QWOP\_rl\_training\_public · ★ 237 · Python · Prototype](https://repo.masters-masters.com/en/repos/LYiHub/QWOP_rl_training_public)
- [iremcnar/loveYou · ★ 237 · Python · Prototype](https://repo.masters-masters.com/en/repos/iremcnar/loveYou)
- [jeetsukumaran/DendroPy · ★ 237 · Python · Prototype](https://repo.masters-masters.com/en/repos/jeetsukumaran/DendroPy)
- [wordnik/wordnik-python · ★ 237 · Python · Prototype](https://repo.masters-masters.com/en/repos/wordnik/wordnik-python)
- [GDSSecurity/GWT-Penetration-Testing-Toolset · ★ 237 · Python · Prototype](https://repo.masters-masters.com/en/repos/GDSSecurity/GWT-Penetration-Testing-Toolset)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.