Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
AlphaUncommon

NotPunchnox/rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

Owner
NotPunchnox (personal account)
Stars
Stars: 618
Forks
Forks: 105
Language
Python
License
GPL-3.0
Created
2024
Topics
aiclient-serveriallmnpuofflineorangepiorangepi5orangepi5propython
Tier
Alpha (250 to 699 ★) What this tier means
View on GitHub

Nearby in Python

All Python repos