BetaRare
kyegomez/LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
- Owner
- kyegomez (personal account)
- Stars
- Stars: 727
- Forks
- Forks: 59
- Language
- Python
- License
- Apache-2.0
- Created
- 2023
- Topics
- artificial-intelligenceattentionattention-is-all-you-needattention-mechanismschatgptgpt3gpt4machine-learningtransformercontext-length
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by kyegomez
All 40 repos by kyegomez- kyegomez/OpenMythosStars: 14,917PythonStable
- kyegomez/swarmsStars: 7,341PythonStable
- kyegomez/tree-of-thoughtsStars: 4,594PythonRC
- kyegomez/BitNetStars: 1,949PythonBeta
- kyegomez/awesome-multi-agent-papersStars: 1,705TeXBeta
- kyegomez/Open-AF3Stars: 808PythonBeta
Nearby in Python
All Python repos- salesforce/xgenStars: 727PythonBeta
- Abilityai/trinityStars: 727PythonBeta
- YMuskrat/arcticdb_mcpStars: 727PythonBeta
- spookylukey/django-paypalStars: 727PythonBeta
- alex/letsencrypt-awsStars: 727PythonBeta
- HouJP/kaggle-quora-question-pairsStars: 727PythonBeta