⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Created Aug 2025
Repositories
14
Total stars
26,711
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Created Aug 2025
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Created Jul 2024
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
Created Nov 2023
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
Created May 2026
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Created Jul 2024
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Created Aug 2025
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
Created Nov 2023
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
Created May 2026
LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
Created Apr 2023
Run 70B+ LLMs on Apple Silicon by using SSD as extended memory — intelligent layer streaming and caching for Mac
Created Feb 2026