BetaRare
RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
- Owner
- RWKV (organization)
- Stars
- Stars: 1,590
- Forks
- Forks: 131
- Language
- C++
- License
- MIT
- Created
- 2023
- Topics
- deep-learninglanguage-modelllmmachine-learningquantizationrwkvggml
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by RWKV
All 2 repos by RWKV- RWKV/RWKV-infctx-trainerStars: 150Jupyter NotebookPrototype
Nearby in C++
All C++ repos- WarmUpTill/SceneSwitcherStars: 1,591C++Beta
- quick-lint/quick-lint-jsStars: 1,591C++Beta
- googlevr/cardboardStars: 1,590C++Beta
- horsicq/XELFViewerStars: 1,589C++Beta
- Grive/griveStars: 1,584C++Beta
- serge-sans-paille/frozenStars: 1,584C++Beta