A technical deep dive on extending GPU memory through KV cache offloading over NFS and S3 with RDMA to cut time-to-first-token and reclaim idle GPU capacity. Covers the prefill/decode split, prefix reuse, and how a persistent KV cache improves GPU capital efficiency for production inference and agentic workloads.