Repositories
12
Total stars
61,736
Trending
Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.
Created May 2026
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Created Aug 2025
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Created Apr 2024
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
Created Nov 2023
LSP server leveraging LLMs for code completion (and more?)
Created Aug 2023
Top
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Created Aug 2025
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
Created Nov 2023
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Created Apr 2024
LSP server leveraging LLMs for code completion (and more?)
Created Aug 2023
Zero-overhead, terminal-native local-LLM orchestrator. Run any engine, any model via the same proxy.
Created May 2026