OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.

Last push 6 days ago

bonsaipure-rustqwen3rustrust-craterust-lang

Created

Apr 2026

Total stars

137

Last 7 days

0

Last 30 days

0

Last 12 months

0

README badge

Rusty Stars badge for cool-japan/oxibonsai
[![Rusty Stars](https://rustystars.dev/badge/cool-japan/oxibonsai.svg)](https://rustystars.dev/cool-japan/oxibonsai)