Illustration drawn by RepoMasters from the repo’s ID and its language color. Credits
PrototypeCommon

cool-japan/oxibonsai

OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.

Owner
cool-japan (personal account)
Stars
Stars: 137
Forks
Forks: 21
Language
Rust
License
Apache-2.0
Created
2026
Topics
bonsaipure-rustqwen3rustrust-craterust-lang
Tier
Prototype (100 to 249 ★) What this tier means
View on GitHub

More repos by cool-japan

All 6 repos by cool-japan

Nearby in Rust

All Rust repos