# Liuhong99/Sophia

<https://repo.masters-masters.com/en/repos/Liuhong99/Sophia>

[Home](https://repo.masters-masters.com/en) › [Liuhong99](https://repo.masters-masters.com/en/owners/Liuhong99) › [Sophia](https://repo.masters-masters.com/en/repos/Liuhong99/Sophia)

Liuhong99/Sophia has 1,002 stars on GitHub. Its RepoMasters card: Beta tier. The official implementation of “Sophia: A Scalable Stochastic Second-order…

| Field | Value |
| --- | --- |
| Owner | [Liuhong99](https://repo.masters-masters.com/en/owners/Liuhong99) |
| Stars | 1,002 |
| Forks | 56 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | MIT |
| Created | 2023 |
| Topics | deep-learning, large-language-models, optimizer |
| Tier | [Beta (700 to 1,999 ★)](https://repo.masters-masters.com/en/ranks/box_office) |
| View on GitHub | [Liuhong99/Sophia](https://github.com/Liuhong99/Sophia) |

## Repository

The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”

The tier for repos with 700 to 1,999 ★. Published odds per card pulled: 6%. Rarity: Rare.

## Nearby in Python

- [fcakyon/autollm · ★ 1,002 · Python · Beta](https://repo.masters-masters.com/en/repos/fcakyon/autollm)
- [chuansirrr/Unsupervised-Log-Anomaly-Detection-Microservices · ★ 1,002 · Python · Beta](https://repo.masters-masters.com/en/repos/chuansirrr/Unsupervised-Log-Anomaly-Detection-Microservices)
- [siyuanchen0214/Scam-AI-Multi-modal-Evaluation-System · ★ 1,002 · Python · Beta](https://repo.masters-masters.com/en/repos/siyuanchen0214/Scam-AI-Multi-modal-Evaluation-System)
- [jfinkels/flask-restless · ★ 1,002 · Python · Beta](https://repo.masters-masters.com/en/repos/jfinkels/flask-restless)
- [LeeSureman/Flat-Lattice-Transformer · ★ 1,002 · Python · Beta](https://repo.masters-masters.com/en/repos/LeeSureman/Flat-Lattice-Transformer)
- [mees/calvin · ★ 1,002 · Python · Beta](https://repo.masters-masters.com/en/repos/mees/calvin)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.