cool-japan/oxibonsai
OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.
bonsaipure-rustqwen3rustrust-craterust-lang
Created
Apr 2026
Total stars
137
Last 7 days
0
Last 30 days
0
Last 12 months
0
README badge
[](https://rustystars.dev/cool-japan/oxibonsai)