AlphaUncommon
lucidrains/ring-attention-pytorch
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
- Owner
- lucidrains (personal account)
- Stars
- Stars: 548
- Forks
- Forks: 36
- Language
- Python
- License
- MIT
- Created
- 2024
- Topics
- attention-mechanismefficient-attentionlong-contextdistributed-attention
- Tier
- Alpha (250 to 699 ★) What this tier means
More repos by lucidrains
All 175 repos by lucidrains- lucidrains/vit-pytorchStars: 25,555PythonLTS
- lucidrains/DALLE2-pytorchStars: 11,306PythonStable
- lucidrains/denoising-diffusion-pytorchStars: 10,723PythonStable
- lucidrains/imagen-pytorchStars: 8,430PythonStable
- lucidrains/PaLM-rlhf-pytorchStars: 7,862PythonStable
- lucidrains/x-transformersStars: 5,962PythonStable
Nearby in Python
All Python repos- zju3dv/Scal3RStars: 548PythonAlpha
- adithya-s-k/FineEnvsStars: 548PythonAlpha
- i12bp8/decomp.wtfStars: 548PythonAlpha
- strohne/FacepagerStars: 548PythonAlpha
- ajinabraham/OWASP-Xenotix-XSS-Exploit-FrameworkStars: 548PythonAlpha
- jonathanslenders/asyncio-redisStars: 548PythonAlpha