Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

liangyuwang/zo2

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]

Owner
liangyuwang (personal account)
Stars
Stars: 208
Forks
Forks: 18
Language
Python
License
Apache-2.0
Created
2025
Topics
llmsoffloadingzeroth-order-optimizationsftdeepseekllamaqwen
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by liangyuwang

All 2 repos by liangyuwang

Nearby in Python

All Python repos