Categories / LLM Infrastructure

Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.

Last push 4 days ago

aiinferenceinference-enginellm-inferencelocal-llmrust

Created

Aug 2026

Total stars

72

Last 7 days

0

Last 30 days

0

Last 12 months

0

README badge

Rusty Stars badge for antonellof/frink
[![Rusty Stars](https://rustystars.dev/badge/antonellof/frink.svg)](https://rustystars.dev/antonellof/frink)