antonellof

antonellof

GitHub

Repositories

1

Total stars

72

Top repositories

Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.

Created Aug 2026

ai inference inference-engine llm-inference rust
Total72