Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

bluorion-com/ZClip

Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".

Owner
bluorion-com (organization)
Stars
Stars: 153
Forks
Forks: 11
Language
Python
License
Apache-2.0
Created
2025
Topics
adaptive-gradient-clippinglossadaptive-clippingloss-spikestable-llm-pretrainingzclipenable-high-learning-ratepre-training-stabilitytraning-stabilityllm-stable-training
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos