Categories / LLM Infrastructure
OrbitInfra/OrbitKV
OrbitKV is a High Performance KV Cache System for LLM Inference.
attentionkv-cachekv-cache-offloadingllm-inferencellm-servingmemory-managementorbiteorbitkvprefix-cachingrustsglangvllm
Created
Mar 2025
Total stars
284
Last 7 days
0
Last 30 days
0
Last 12 months
0
README badge
[](https://rustystars.dev/OrbitInfra/OrbitKV)