PrototypeCommon
lucidrains/electra-pytorch
A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
- Owner
- lucidrains (personal account)
- Stars
- Stars: 237
- Forks
- Forks: 46
- Language
- Python
- License
- MIT
- Created
- 2020
- Topics
- artificial-intelligencedeep-learningpre-trainingtransformer
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by lucidrains
All 175 repos by lucidrains- lucidrains/vit-pytorchStars: 25,555PythonLTS
- lucidrains/DALLE2-pytorchStars: 11,306PythonStable
- lucidrains/denoising-diffusion-pytorchStars: 10,723PythonStable
- lucidrains/imagen-pytorchStars: 8,430PythonStable
- lucidrains/PaLM-rlhf-pytorchStars: 7,862PythonStable
- lucidrains/x-transformersStars: 5,962PythonStable
Nearby in Python
All Python repos- Hyacehila/humanizer-zh-nextStars: 237PythonPrototype
- LYiHub/QWOP_rl_training_publicStars: 237PythonPrototype
- iremcnar/loveYouStars: 237PythonPrototype
- jeetsukumaran/DendroPyStars: 237PythonPrototype
- wordnik/wordnik-pythonStars: 237PythonPrototype
- GDSSecurity/GWT-Penetration-Testing-ToolsetStars: 237PythonPrototype