Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

Haiyang-W/TokenFormer

[ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

Owner
Haiyang-W (personal account)
Stars
Stars: 596
Forks
Forks: 42
Language
Python
License
Apache-2.0
Created
2024
Topics
architecturefoundation-modelsllmscaling-methodstransformerattention-mechanism
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

More repos by Haiyang-W

All 4 repos by Haiyang-W

Nearby in Python

All Python repos