Illustration drawn by RepoMasters from the repoโ€™s ID and its language color. Credits
PrototypeCommon

ChenLiu-1996/LM-Dispersion

[๐—œ๐—–๐— ๐—Ÿ ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฒ] Dispersion loss counteracts embedding condensation and improves generalization in small language models

Owner
ChenLiu-1996 (personal account)
Stars
Stars: 123
Forks
Forks: 6
Language
Python
License
None
Created
2025
Topics
icmlicml-2026llmllm-trainingllmsmanifold-learningcondensationdispersionembeddinglarge-language-models
Tier
Prototype (100 to 249 โ˜…) What this tier means
View on GitHub

More repos by ChenLiu-1996

All 3 repos by ChenLiu-1996

Nearby in Python

All Python repos