Categories / Artificial Intelligence

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Last push 1 week ago

api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-aimachine-learningollama-apiopenai-compatiblerustrust-cratetransformerswebgpuwebgpu-shaders

Created

Aug 2025

Total stars

6,021

Last 7 days

+12

Last 30 days

+44

Last 12 months

+2,751

Used by crates

0

Downloads, 90 days

770

README badge

Rusty Stars badge for Michael-A-Kuykendall/shimmy
[![Rusty Stars](https://rustystars.dev/badge/Michael-A-Kuykendall/shimmy.svg)](https://rustystars.dev/Michael-A-Kuykendall/shimmy)