Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

BorealisAI/flora-opt

This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.

Owner
BorealisAI (organization)
Stars
Stars: 106
Forks
Forks: 5
Language
Python
License
LGPL-3.0
Created
2024
Topics
deep-learningflaxjaxlarge-language-modelsloramemory-efficient-tuningoptaxpeftrandom-projectiontransformers
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by BorealisAI

All 5 repos by BorealisAI

Nearby in Python

All Python repos