Dual-Axis KV Sharing: Integrating Joint-KV with Cross-Layer and Prefix-Shared Attention
Combine branch-wise KV sharing with cross-layer KV caching to eliminate redundant key-value memory traffic across both network depth and parallel architectural branches.