Categories / LLM Infrastructure
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.
Created
Sep 2026
Total stars
78
Last 7 days
+8
Last 30 days
+31
Last 12 months
+79
README badge
[](https://rustystars.dev/midagedev/bloomery)