# BlinkDL/RWKV-LM

<https://repo.masters-masters.com/en/repos/BlinkDL/RWKV-LM>

[Home](https://repo.masters-masters.com/en) › [BlinkDL](https://repo.masters-masters.com/en/owners/BlinkDL) › [RWKV-LM](https://repo.masters-masters.com/en/repos/BlinkDL/RWKV-LM)

BlinkDL/RWKV-LM has 14,772 stars on GitHub. Its RepoMasters card: Stable tier. RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also…

| Field | Value |
| --- | --- |
| Owner | [BlinkDL](https://repo.masters-masters.com/en/owners/BlinkDL) |
| Stars | 14,772 |
| Forks | 1,026 |
| Language | [Python](https://repo.masters-masters.com/en/languages/python) |
| License | Apache-2.0 |
| Created | 2021 |
| Topics | attention-mechanism, deep-learning, gpt, gpt-2, gpt-3, language-model, linear-attention, lstm, pytorch, rnn |
| Tier | [Stable (5,000 to 19,999 ★)](https://repo.masters-masters.com/en/ranks/cult) |
| View on GitHub | [BlinkDL/RWKV-LM](https://github.com/BlinkDL/RWKV-LM) |

## Repository

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infin…

The tier for repos with 5,000 to 19,999 ★. Published odds per card pulled: 0.9%. Rarity: Very rare.

## More repos by BlinkDL

- [BlinkDL/ChatRWKV · ★ 9,493 · Python · Stable](https://repo.masters-masters.com/en/repos/BlinkDL/ChatRWKV)
- [BlinkDL/AI-Writer · ★ 3,935 · Python · RC](https://repo.masters-masters.com/en/repos/BlinkDL/AI-Writer)
- [BlinkDL/Hua · ★ 358 · Alpha](https://repo.masters-masters.com/en/repos/BlinkDL/Hua)
- [BlinkDL/RWKV-CUDA · ★ 234 · Cuda · Prototype](https://repo.masters-masters.com/en/repos/BlinkDL/RWKV-CUDA)
- [BlinkDL/Albatross · ★ 133 · Cuda · Prototype](https://repo.masters-masters.com/en/repos/BlinkDL/Albatross)

## Nearby in Python

- [llmware-ai/llmware · ★ 14,819 · Python · Stable](https://repo.masters-masters.com/en/repos/llmware-ai/llmware)
- [aiming-lab/AutoResearchClaw · ★ 14,814 · Python · Stable](https://repo.masters-masters.com/en/repos/aiming-lab/AutoResearchClaw)
- [ShangtongZhang/reinforcement-learning-an-introduction · ★ 14,797 · Python · Stable](https://repo.masters-masters.com/en/repos/ShangtongZhang/reinforcement-learning-an-introduction)
- [nltk/nltk · ★ 14,766 · Python · Stable](https://repo.masters-masters.com/en/repos/nltk/nltk)
- [LlamaChinese/Llama-Chinese · ★ 14,755 · Python · Stable](https://repo.masters-masters.com/en/repos/LlamaChinese/Llama-Chinese)
- [SesameAILabs/csm · ★ 14,741 · Python · Stable](https://repo.masters-masters.com/en/repos/SesameAILabs/csm)

---
Data: GitHub · Illustration drawn by RepoMasters from the repo’s ID and its language color.