Categories / LLM Infrastructure
Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.
Created
Sep 2026
Total stars
78
Last 7 days
0
Last 30 days
0
Last 12 months
0
README badge
[](https://rustystars.dev/midagedev/bloomery)