# liangyuwang/zo2

<https://repo.masters-masters.com/en/repos/liangyuwang/zo2>

[Home](https://repo.masters-masters.com/en) › [liangyuwang](https://repo.masters-masters.com/en/owners/liangyuwang) › [zo2](https://repo.masters-masters.com/en/repos/liangyuwang/zo2)

liangyuwang/zo2 has 208 stars on GitHub. Its RepoMasters card: Prototype tier. ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB…

| Field | Value |
| --- | --- |
| Owner | [liangyuwang](https://repo.masters-masters.com/en/owners/liangyuwang) |
| Stars | 208 |
| Forks | 18 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2025 |
| Topics | llms, offloading, zeroth-order-optimization, sft, deepseek, llama, qwen |
| Tier | [Prototype (100 to 249 ★)](https://repo.masters-masters.com/en/ranks/rush) |
| View on GitHub | [liangyuwang/zo2](https://github.com/liangyuwang/zo2) |

## Repository

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory \[COLM2025\]

The tier for repos with 100 to 249 ★. Published odds per card pulled: 70%. Rarity: Common.

## More repos by liangyuwang

- [liangyuwang/Tiny-FSDP · ★ 111 · Python · Prototype](https://repo.masters-masters.com/en/repos/liangyuwang/Tiny-FSDP)

## Nearby in Python

- [modal-labs/overeasy · ★ 208 · Python · Prototype](https://repo.masters-masters.com/en/repos/modal-labs/overeasy)
- [vstorm-co/agenticos · ★ 208 · Python · Prototype](https://repo.masters-masters.com/en/repos/vstorm-co/agenticos)
- [alihammoud21/playgta5 · ★ 208 · Python · Prototype](https://repo.masters-masters.com/en/repos/alihammoud21/playgta5)
- [davecranwell/inline-styler · ★ 208 · Python · Prototype](https://repo.masters-masters.com/en/repos/davecranwell/inline-styler)
- [pandaproject/panda · ★ 208 · Python · Prototype](https://repo.masters-masters.com/en/repos/pandaproject/panda)
- [finiteloop/socialcookbook · ★ 208 · Python · Prototype](https://repo.masters-masters.com/en/repos/finiteloop/socialcookbook)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.
