PrototypeCommon
kyegomez/SparseAttention
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
- Owner
- kyegomez (personal account)
- Stars
- Stars: 102
- Forks
- Forks: 7
- Language
- Python
- License
- MIT
- Created
- 2023
- Topics
- artificial-intelligenceattention-is-all-you-needattention-mechanismattention-mechanismsmachine-learningsparse-matrixsparse-attn
- Tier
- Prototype (100 to 249 ★) What this tier means
More repos by kyegomez
All 40 repos by kyegomez- kyegomez/OpenMythosStars: 14,921PythonStable
- kyegomez/swarmsStars: 7,345PythonStable
- kyegomez/tree-of-thoughtsStars: 4,593PythonRC
- kyegomez/BitNetStars: 1,949PythonBeta
- kyegomez/awesome-multi-agent-papersStars: 1,706TeXBeta
- kyegomez/Open-AF3Stars: 808PythonBeta
Nearby in Python
All Python repos- Chenkin-x/ComfyUI-Moss-Image-EditStars: 102PythonPrototype
- lucasbabur/jp-essayStars: 102PythonPrototype
- jjs202210-jpg/dashi-wo-wu-leStars: 102PythonPrototype
- chb/indivo_serverStars: 102PythonPrototype
- irskep/pyglettutorialStars: 102PythonPrototype
- willrjmarshall/AbletonDJTemplateUnsupportedStars: 102PythonPrototype