GitHub topics

mlx

27% of these repos are in LLM Infrastructure, 18% in Productivity.

Repositories

11

Total stars

41,138

Trending

AlexsJones

Hundreds of models & providers. One command to find what runs on your hardware.

Created Feb 2026

gguf llm localai mlx skill
Total39,119
30 days +1,046
Epistates

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

Created Jan 2026

ai ane apple-silicon deep-learning distillation
Total333
30 days +3

Top

AlexsJones

Hundreds of models & providers. One command to find what runs on your hardware.

Created Feb 2026

gguf llm localai mlx skill
Total39,119
Epistates

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

Created Jan 2026

ai ane apple-silicon deep-learning distillation
Total333
ferrumox

A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.

Created Mar 2026

Total191
truespar

Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

Created Sep 2026

ai aimodels blackwell cuda inference
Total165
MIT-RLX

Pure rust ML compiler with IR and support for multiple backends

Created May 2026

compiler cortexm cpu cuda fpga
Total50

Related

All topics →