Categories / LLM Infrastructure

Blazing-fast LLM inference in pure Rust. No PyTorch and Python runtime.

Last push 3 weeks ago

Created

Jun 2025

Total stars

356

Last 7 days

+2

Last 30 days

+17

Last 12 months

+294

README badge

Rusty Stars badge for guoqingbao/xinfer
[![Rusty Stars](https://rustystars.dev/badge/guoqingbao/xinfer.svg)](https://rustystars.dev/guoqingbao/xinfer)