Categories / LLM Infrastructure

Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.

Last push 6 days ago

Created

Aug 2026

Total stars

72

Last 7 days

+1

Last 30 days

+10

Last 12 months

+72

Used by crates

8

Downloads, 90 days

1,678

README badge

Rusty Stars badge for antonellof/frink
[![Rusty Stars](https://rustystars.dev/badge/antonellof/frink.svg)](https://rustystars.dev/antonellof/frink)