# kyegomez/LongNet

<https://repo.masters-masters.com/en/repos/kyegomez/LongNet>

[Home](https://repo.masters-masters.com/en) › [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) › [LongNet](https://repo.masters-masters.com/en/repos/kyegomez/LongNet)

kyegomez/LongNet has 727 stars on GitHub. Its RepoMasters card: Beta tier. Implementation of plug in and play Attention from "LongNet: Scaling Transformers to…

| Field | Value |
| --- | --- |
| Owner | [kyegomez](https://repo.masters-masters.com/en/owners/kyegomez) |
| Stars | 727 |
| Forks | 59 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | artificial-intelligence, attention, attention-is-all-you-need, attention-mechanisms, chatgpt, gpt3, gpt4, machine-learning, transformer, context-length |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [kyegomez/LongNet](https://github.com/kyegomez/LongNet) |

## Repository

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## More repos by kyegomez

- [kyegomez/OpenMythos · ★ 14,921 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/OpenMythos)
- [kyegomez/swarms · ★ 7,345 · Python · Stable](https://repo.masters-masters.com/en/repos/kyegomez/swarms)
- [kyegomez/tree-of-thoughts · ★ 4,593 · Python · RC](https://repo.masters-masters.com/en/repos/kyegomez/tree-of-thoughts)
- [kyegomez/BitNet · ★ 1,949 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/BitNet)
- [kyegomez/awesome-multi-agent-papers · ★ 1,706 · TeX · Beta](https://repo.masters-masters.com/en/repos/kyegomez/awesome-multi-agent-papers)
- [kyegomez/Open-AF3 · ★ 808 · Python · Beta](https://repo.masters-masters.com/en/repos/kyegomez/Open-AF3)

## Nearby in Python

- [salesforce/xgen · ★ 727 · Python · Beta](https://repo.masters-masters.com/en/repos/salesforce/xgen)
- [balazik/ComfyUI-PuLID-Flux · ★ 727 · Python · Beta](https://repo.masters-masters.com/en/repos/balazik/ComfyUI-PuLID-Flux)
- [peass-ng/CloudPEASS · ★ 727 · Python · Beta](https://repo.masters-masters.com/en/repos/peass-ng/CloudPEASS)
- [spookylukey/django-paypal · ★ 727 · Python · Beta](https://repo.masters-masters.com/en/repos/spookylukey/django-paypal)
- [alex/letsencrypt-aws · ★ 727 · Python · Beta](https://repo.masters-masters.com/en/repos/alex/letsencrypt-aws)
- [HouJP/kaggle-quora-question-pairs · ★ 727 · Python · Beta](https://repo.masters-masters.com/en/repos/HouJP/kaggle-quora-question-pairs)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.