Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

Beomi/InfiniTransformer

Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Owner
Beomi (personal account)
Stars
Stars: 375
Forks
Forks: 35
Language
Python
License
MIT
Created
2024
Topics
gemmahuggingfacepytorchtransformersinfinitransformerllamallama3
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by Beomi

All 5 repos by Beomi

Nearby in Python

All Python repos