Categories / LLM Infrastructure
antonellof/frink
Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.
Created
Aug 2026
Total stars
72
Last 7 days
0
Last 30 days
0
Last 12 months
0
README badge
[](https://rustystars.dev/antonellof/frink)