Categories / LLM Infrastructure

High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.

Last push 3 days ago

Created

Jan 2026

Total stars

222

Last 7 days

+1

Last 30 days

+4

Last 12 months

+222

README badge

Rusty Stars badge for novitalabs/pegaflow
[![Rusty Stars](https://rustystars.dev/badge/novitalabs/pegaflow.svg)](https://rustystars.dev/novitalabs/pegaflow)