KV Packet: Recomputation-Free Context-Independent KV Caching for LLMs
Paper • 2604.13226 • Published • 11
Non-prefix KV Reuse
-
-
KVLink: Accelerating Large Language Models via Efficient KV Cache Reuse
Paper • 2502.16002 • Published -
ProphetKV: User-Query-Driven Selective Recomputation for Efficient KV Cache Reuse in Retrieval-Augmented Generation
Paper • 2602.02579 • Published -
From Prefix Cache to Fusion RAG Cache: Accelerating LLM Inference in Retrieval-Augmented Generation
Paper • 2601.12904 • Published -
CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion
Paper • 2405.16444 • Published • 1 -
QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving
Paper • 2606.05875 • Published