BetaRare
Liuhong99/Sophia
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
- Owner
- Liuhong99 (personal account)
- Stars
- Stars: 1,002
- Forks
- Forks: 56
- Language
- Python
- License
- MIT
- Created
- 2023
- Topics
- deep-learninglarge-language-modelsoptimizer
- Tier
- Beta (700 to 1,999 ★) What this tier means
Nearby in Python
All Python repos- fcakyon/autollmStars: 1,002PythonBeta
- chuansirrr/Unsupervised-Log-Anomaly-Detection-MicroservicesStars: 1,002PythonBeta
- siyuanchen0214/Scam-AI-Multi-modal-Evaluation-SystemStars: 1,002PythonBeta
- jfinkels/flask-restlessStars: 1,002PythonBeta
- LeeSureman/Flat-Lattice-TransformerStars: 1,002PythonBeta
- mees/calvinStars: 1,002PythonBeta