# LiyuanLucasLiu/RAdam

<https://repo.masters-masters.com/en/repos/LiyuanLucasLiu/RAdam>

[Home](https://repo.masters-masters.com/en) › [LiyuanLucasLiu](https://repo.masters-masters.com/en/owners/LiyuanLucasLiu) › [RAdam](https://repo.masters-masters.com/en/repos/LiyuanLucasLiu/RAdam)

LiyuanLucasLiu/RAdam has 2,548 stars on GitHub. Its RepoMasters card: RC tier. On the Variance of the Adaptive Learning Rate and Beyond Language: Python.

| Field | Value |
| --- | --- |
| Owner | [LiyuanLucasLiu](https://repo.masters-masters.com/en/owners/LiyuanLucasLiu) |
| Stars | 2,548 |
| Forks | 329 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2019 |
| Topics | optimizer, adam, adam-optimizer, warmup |
| Tier | [RC (2,000 to 4,999 ★)](https://repo.masters-masters.com/en/ranks/blockbuster) |
| View on GitHub | [LiyuanLucasLiu/RAdam](https://github.com/LiyuanLucasLiu/RAdam) |

## Repository

On the Variance of the Adaptive Learning Rate and Beyond

The tier for repos with 2,000 to 4,999 ★. Published odds per card pulled: 3%. Rarity: Epic.

## More repos by LiyuanLucasLiu

- [LiyuanLucasLiu/LM-LSTM-CRF · ★ 844 · Python · Beta](https://repo.masters-masters.com/en/repos/LiyuanLucasLiu/LM-LSTM-CRF)
- [LiyuanLucasLiu/Transformer-Clinic · ★ 331 · Python · Alpha](https://repo.masters-masters.com/en/repos/LiyuanLucasLiu/Transformer-Clinic)
- [LiyuanLucasLiu/LD-Net · ★ 147 · Python · Prototype](https://repo.masters-masters.com/en/repos/LiyuanLucasLiu/LD-Net)
- [LiyuanLucasLiu/LightNER · ★ 118 · Python · Prototype](https://repo.masters-masters.com/en/repos/LiyuanLucasLiu/LightNER)

## Nearby in Python

- [kalil0321/reverse-api-engineer · ★ 2,549 · Python · RC](https://repo.masters-masters.com/en/repos/kalil0321/reverse-api-engineer)
- [learning-at-home/hivemind · ★ 2,548 · Python · RC](https://repo.masters-masters.com/en/repos/learning-at-home/hivemind)
- [dsphper/lanhu-mcp · ★ 2,548 · Python · RC](https://repo.masters-masters.com/en/repos/dsphper/lanhu-mcp)
- [openai/weak-to-strong · ★ 2,547 · Python · RC](https://repo.masters-masters.com/en/repos/openai/weak-to-strong)
- [harry0703/AudioNotes · ★ 2,547 · Python · RC](https://repo.masters-masters.com/en/repos/harry0703/AudioNotes)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.