Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

Guitaricet/relora

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

Owner
Guitaricet (personal account)
Stars
Stars: 477
Forks
Forks: 42
Language
Jupyter Notebook
License
Apache-2.0
Created
2023
Topics
deep-learningdistributed-trainingllamanlppefttransformer
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Jupyter Notebook

All Jupyter Notebook repos