NVIDIA CMX Context Memory Storage Platform

The NVIDIA BlueField platform accelerates NVIDIA CMX by delivering breakthrough performance, efficiency, and innovation. BlueField-4 manages Non-Volatile Memory Express (NVMe) solid-state drives (SSDs), runs storage services, and offloads data integrity and encryption for KV cache with high power efficiency. Its advanced compute capabilities and software-defined hardware accelerators for networking, storage, and security create a secure, energy-efficient infrastructure for every workload.

NVIDIA DOCA Memos is a BlueField-4- and CMX-optimized SDK that manages and shares KV cache across AI compute and CMX data nodes, exposing simple key-value APIs and turning Ethernet-attached flash into a pod-level cache tier. It delivers secure, low-latency access with hardware-accelerated integrity and encryption, so applications stay stateless while CMX handles KV-cache routing and reuse at scale.

NVIDIA Spectrum-X Ethernet provides the high-performance remote direct-memory access (RDMA) fabric for low-latency, high-bandwidth access to AI-native KV cache across the pod. Purpose-built for AI, Spectrum-X Ethernet uses advanced congestion control, adaptive routing, and lossless RDMA Over Converged Ethernet (RoCE) to minimize jitter and tail latency, delivering consistent, repeatable performance in large, multi-tenant environments. This allows CMX to scale with predictable high performance, maximizing throughput and responsiveness for multi-turn, agentic inference workloads.

NVIDIA Dynamo is a distributed inference-serving framework that makes CMX and the underlying context storage tiers appear seamless across the pod, routing requests to where KV cache already resides. By handling KV-aware placement and reuse in the serving layer, Dynamo increases tokens per second, reduces time to first token, and enables pod-wide context reuse for multi-turn, multi-agent workloads.