Categories / LLM Infrastructure
pegainfer-project/pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
cudacuda-kernelsdeepseekgpuinferenceinference-enginekimikimi-k2kv-cachellmllm-inferencellm-servingmodel-servingmoeopenai-apipaged-attentionqwenqwen3rustvllm
Created
Feb 2026
Total stars
748
Last 7 days
+6
Last 30 days
+25
Last 12 months
+747
README badge
[](https://rustystars.dev/pegainfer-project/pegainfer)