BetaRare
RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
- Owner
- RahulSChand (personal account)
- Stars
- Stars: 1,401
- Forks
- Forks: 87
- Language
- JavaScript
- License
- None
- Created
- 2023
- Topics
- ggmlhuggingfacellmquantizationgpulanguage-modelpytorchllamallama2llamacpp
- Tier
- Beta (700 to 1,999 ★) What this tier means
More repos by RahulSChand
All 2 repos by RahulSChand- RahulSChand/llama2.c-for-dummiesStars: 234CPrototype
Nearby in JavaScript
All JavaScript repos- wikieden/Freedom-To-Chatgpt-Claude-AgentStars: 1,402JavaScriptBeta
- sindresorhus/multilineStars: 1,401JavaScriptBeta
- RonitSachdev/ccundoStars: 1,401JavaScriptBeta
- mythz/jquipStars: 1,400JavaScriptBeta
- angular-ui/AngularJS-sublime-packageStars: 1,400JavaScriptBeta