Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits

AlphaUncommon

dingo-actual/infini-transformer

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

Owner: dingo-actual (personal account)
Stars: Stars: 301
Forks: Forks: 24
Language: Python
License: MIT
Created: 2024
Topics: attention-mechanismdeep-learninglong-contextpytorchtransformersinfini-attentionmixture-of-depths
Tier: Alpha (250 to 699 ★) What this tier means

View on GitHub

Nearby in Python

All Python repos

duckyshell/ComfyUI-MiniMaxH3-Prompt-WriterStars: 301PythonAlpha
HKUST-LongGroup/UniAVCStars: 301PythonAlpha
QuantumBladesmith/FPS-Optimizer-Universal-Game-Performance-Booster-2026Stars: 301PythonAlpha
tegaki/tegakiStars: 301PythonAlpha
pyside/PySideStars: 301PythonAlpha
kylebgorman/textgridStars: 301PythonAlpha