AlphaUncommon
lucidrains/memory-efficient-attention-pytorch
Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
- Owner
- lucidrains (personal account)
- Stars
- Stars: 395
- Forks
- Forks: 36
- Language
- Python
- License
- MIT
- Created
- 2022
- Topics
- artificial-intelligencedeep-learningattention-mechanismmemory-efficient
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by lucidrains
All 175 repos by lucidrains- lucidrains/vit-pytorchStars: 25,554PythonLTS
- lucidrains/DALLE2-pytorchStars: 11,306PythonStable
- lucidrains/denoising-diffusion-pytorchStars: 10,724PythonStable
- lucidrains/imagen-pytorchStars: 8,429PythonStable
- lucidrains/PaLM-rlhf-pytorchStars: 7,863PythonStable
- lucidrains/x-transformersStars: 5,962PythonStable
Nearby in Python
All Python repos- ddys9621/WenlanAIStars: 395PythonAlpha
- amazon-far/abcStars: 395PythonAlpha
- OpenBMB/MeshyStars: 395PythonAlpha
- atizo/PyTagCloudStars: 395PythonAlpha
- mgrouchy/django-strongholdStars: 395PythonAlpha
- rizsotto/scan-buildStars: 395PythonAlpha