Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
BetaRare

lucidrains/rotary-embedding-torch

Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch

Owner
lucidrains (personal account)
Stars
Stars: 827
Forks
Forks: 69
Language
Python
License
MIT
Created
2021
Topics
artificial-intelligencedeep-learningpositional-encoding
Tier
Beta (700 to 1,999 ★) What this tier means
View on GitHub

More repos by lucidrains

All 175 repos by lucidrains

Nearby in Python

All Python repos