midagedev

midagedev

GitHub

Repositories

1

Total stars

78

Top repositories

Hybrid GPU + CPU inference for mixture-of-experts models, written in Rust down to the CUDA kernels. A drop-in llama-server.

Created Sep 2026

cuda deepseek gguf glm inference
Total78