kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
Live
Open / InstallLast updated July 27, 2026
Description
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond. An open-source AI framework/SDK by ovg-project, hosted on GitHub.
Author
ovg-project
Platform
api
Pricing model
free
Categories
AI Frameworks
Tags
elastic-kvcache
gpu-mutiplexing
gpu-sharing
inference-engine
kvcache
kvcache-optimization
kvcached
llm
github
Capabilities
- 1,117 stars
- Python