# Beomi/InfiniTransformer

<https://repo.masters-masters.com/en/repos/Beomi/InfiniTransformer>

[Home](https://repo.masters-masters.com/en) › [Beomi](https://repo.masters-masters.com/en/owners/Beomi) › [InfiniTransformer](https://repo.masters-masters.com/en/repos/Beomi/InfiniTransformer)

Beomi/InfiniTransformer has 375 stars on GitHub. Its RepoMasters card: Alpha tier. Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No…

| Field | Value |
| --- | --- |
| Owner | [Beomi](https://repo.masters-masters.com/en/owners/Beomi) |
| Stars | 375 |
| Forks | 35 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | gemma, huggingface, pytorch, transformers, infinitransformer, llama, llama3 |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [Beomi/InfiniTransformer](https://github.com/Beomi/InfiniTransformer) |

## Repository

Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## More repos by Beomi

- [Beomi/KoAlpaca · ★ 1,572 · Jupyter Notebook · Beta](https://repo.masters-masters.com/en/repos/Beomi/KoAlpaca)
- [Beomi/KcBERT · ★ 497 · Alpha](https://repo.masters-masters.com/en/repos/Beomi/KcBERT)
- [Beomi/BitNet-Transformers · ★ 318 · Python · Alpha](https://repo.masters-masters.com/en/repos/Beomi/BitNet-Transformers)
- [Beomi/KcELECTRA · ★ 267 · Alpha](https://repo.masters-masters.com/en/repos/Beomi/KcELECTRA)

## Nearby in Python

- [codeaashu/free-claude-code · ★ 375 · Python · Alpha](https://repo.masters-masters.com/en/repos/codeaashu/free-claude-code)
- [zonko-ai/harbor-sdk · ★ 375 · Python · Alpha](https://repo.masters-masters.com/en/repos/zonko-ai/harbor-sdk)
- [GC-STEM/it140-m4-assignment · ★ 375 · Python · Alpha](https://repo.masters-masters.com/en/repos/GC-STEM/it140-m4-assignment)
- [mrjoes/tornadio · ★ 375 · Python · Alpha](https://repo.masters-masters.com/en/repos/mrjoes/tornadio)
- [leeroybrun/glacier-vault-remove · ★ 375 · Python · Alpha](https://repo.masters-masters.com/en/repos/leeroybrun/glacier-vault-remove)
- [cholcombe973/autodock · ★ 375 · Python · Alpha](https://repo.masters-masters.com/en/repos/cholcombe973/autodock)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.
