RCEpic
vitoplantamura/OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
- Owner
- vitoplantamura (personal account)
- Stars
- Stars: 2,089
- Forks
- Forks: 99
- Language
- C++
- License
- None
- Created
- 2023
- Topics
- machine-learningonnxraspberry-pistable-diffusionllamamistraltinymlwasmwebassemblyyolov8
- Tier
- RC (2,000 to 4,999 ★) What this tier means
More repos by vitoplantamura
All 4 repos by vitoplantamura- vitoplantamura/BugCheckerStars: 1,067CBeta
- vitoplantamura/MagicTrackpad2ForWindowsStars: 890CBeta
- vitoplantamura/HackerNewsRemovalsStars: 454C#Alpha
Nearby in C++
All C++ repos- stepfun-ai/Step-3.5-FlashStars: 2,090C++RC
- ossia/scoreStars: 2,089C++RC
- facebookresearch/ELFStars: 2,089C++RC
- TileDB-Inc/TileDBStars: 2,088C++RC
- ssloy/tinyraycasterStars: 2,088C++RC