Categories / Artificial Intelligence
Michael-A-Kuykendall/shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
api-servercommand-line-tooldeveloper-toolsggufhuggingfacehuggingface-modelshuggingface-transformersinference-serverllamallamacppllm-inferencelocal-aimachine-learningollama-apiopenai-compatiblerustrust-cratetransformerswebgpuwebgpu-shaders
Created
Aug 2025
Total stars
6,021
Last 7 days
+12
Last 30 days
+44
Last 12 months
+2,751
README badge
[](https://rustystars.dev/Michael-A-Kuykendall/shimmy)