Categories / LLM Infrastructure
Run Qwen 3.8 MAX (2.4T MoE) on a 50GB-RAM consumer machine in pure Rust, experts streamed from disk. Tiny engine, immense model.
Created
Jul 2026
Total stars
193
Last 7 days
+1
Last 30 days
+2
Last 12 months
+193
README badge
[](https://rustystars.dev/ferrumox/rabbit)