StableVery rare
BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infin…
- Owner
- BlinkDL (personal account)
- Stars
- Stars: 14,772
- Forks
- Forks: 1,026
- Language
- Python
- License
- Apache-2.0
- Created
- 2021
- Topics
- attention-mechanismdeep-learninggptgpt-2gpt-3language-modellinear-attentionlstmpytorchrnn
- Tier
- Stable (5,000 to 19,999 ★) What this tier means
More repos by BlinkDL
All 6 repos by BlinkDL- BlinkDL/ChatRWKVStars: 9,493PythonStable
- BlinkDL/AI-WriterStars: 3,935PythonRC
- BlinkDL/HuaStars: 358Alpha
- BlinkDL/RWKV-CUDAStars: 234CudaPrototype
- BlinkDL/AlbatrossStars: 133CudaPrototype
Nearby in Python
All Python repos- llmware-ai/llmwareStars: 14,818PythonStable
- aiming-lab/AutoResearchClawStars: 14,809PythonStable
- ShangtongZhang/reinforcement-learning-an-introductionStars: 14,797PythonStable
- nltk/nltkStars: 14,766PythonStable
- LlamaChinese/Llama-ChineseStars: 14,754PythonStable
- SesameAILabs/csmStars: 14,739PythonStable