Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
RCEpic

LiyuanLucasLiu/RAdam

On the Variance of the Adaptive Learning Rate and Beyond

Owner
LiyuanLucasLiu (personal account)
Stars
Stars: 2,548
Forks
Forks: 329
Language
Python
License
Apache-2.0
Created
2019
Topics
optimizeradamadam-optimizerwarmup
Tier
RC (2,000 to 4,999 ★) What this tier means
View on GitHub

More repos by LiyuanLucasLiu

All 5 repos by LiyuanLucasLiu

Nearby in Python

All Python repos