# Guitaricet/relora

<https://repo.masters-masters.com/en/repos/Guitaricet/relora>

[Home](https://repo.masters-masters.com/en) › [Guitaricet](https://repo.masters-masters.com/en/owners/Guitaricet) › [relora](https://repo.masters-masters.com/en/repos/Guitaricet/relora)

Guitaricet/relora has 477 stars on GitHub. Its RepoMasters card: Alpha tier. Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank…

| Field | Value |
| --- | --- |
| Owner | [Guitaricet](https://repo.masters-masters.com/en/owners/Guitaricet) |
| Stars | 477 |
| Forks | 42 |
| Language | [Jupyter Notebook](https://repo.masters-masters.com/en/languages/jupyter-notebook) |
| License | Apache-2.0 |
| Created | 2023 |
| Topics | deep-learning, distributed-training, llama, nlp, peft, transformer |
| Tier | [Alpha (250 to 699 ★)](https://repo.masters-masters.com/en/ranks/b_movie) |
| View on GitHub | [Guitaricet/relora](https://github.com/Guitaricet/relora) |

## Repository

Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates

The tier for repos with 250 to 699 ★. Published odds per card pulled: 20%. Rarity: Uncommon.

## Nearby in Jupyter Notebook

- [mikexcohen/LinAlg4DataScience · ★ 477 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/mikexcohen/LinAlg4DataScience)
- [Eddie-Wang1120/HPC-Learning-Notes · ★ 477 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/Eddie-Wang1120/HPC-Learning-Notes)
- [wiseaidev/rust-data-analysis · ★ 477 · Jupyter Notebook · Alpha](https://repo.masters-masters.com/en/repos/wiseaidev/rust-data-analysis)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.