pegainfer-project

pegainfer-project

GitHub

Repositories

3

Total stars

1,013

Top repositories

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Created Feb 2026

cuda cuda-kernels deepseek gpu inference
Total748

A model-agnostic GPU runtime for shipping models as verified programs.

Created Aug 2026

cuda gpu-inference llm-inference rust
Total214

OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.

Created Sep 2026

cuda full-duplex gpt-live inference-server llm-serving
Total51