# dingo-actual/infini-transformer

<https://repo.masters-masters.com/en/repos/dingo-actual/infini-transformer>

[Home](https://repo.masters-masters.com/en) › [dingo-actual](https://repo.masters-masters.com/en/owners/dingo-actual) › [infini-transformer](https://repo.masters-masters.com/en/repos/dingo-actual/infini-transformer)

dingo-actual/infini-transformer has 301 stars on GitHub. Its RepoMasters card: Alpha tier. PyTorch implementation of Infini-Transformer from "Leave No Context…

| Field | Value |
| --- | --- |
| Owner | [dingo-actual](https://repo.masters-masters.com/en/owners/dingo-actual) |
| Stars | 301 |
| Forks | 24 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2024 |
| Topics | attention-mechanism, deep-learning, long-context, pytorch, transformers, infini-attention, mixture-of-depths |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [dingo-actual/infini-transformer](https://github.com/dingo-actual/infini-transformer) |

## Repository

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Python

- [duckyshell/ComfyUI-MiniMaxH3-Prompt-Writer · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/duckyshell/ComfyUI-MiniMaxH3-Prompt-Writer)
- [HKUST-LongGroup/UniAVC · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/HKUST-LongGroup/UniAVC)
- [QuantumBladesmith/FPS-Optimizer-Universal-Game-Performance-Booster-2026 · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/QuantumBladesmith/FPS-Optimizer-Universal-Game-Performance-Booster-2026)
- [tegaki/tegaki · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/tegaki/tegaki)
- [pyside/PySide · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/pyside/PySide)
- [kylebgorman/textgrid · ★ 301 · Python · Alpha](https://repo.masters-masters.com/en/repos/kylebgorman/textgrid)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.