AMD today unveiled ROCm 7.0, a massive update to its open GPU software platform for AI workloads across datacenter racks and even client devices. The release focuses on support for the new Instinct MI350 accelerator series, built on CDNA 4. It pairs hardware-level refinements, including advanced HBM utilization and expanded datatype handling, with software improvements designed to enhance throughput for both training and inference. AMD classifies this release as a generational step that widens deployment choices for enterprises, from single-node servers to multi-rack clusters. Company benchmarks shared with partners indicate multi-fold gains over previous ROCm 6.0 versions on select large-model tasks, and AMD shows tighter integration with open-source serving stacks to help teams transition from prototype to production more quickly.

Under the hood, ROCm 7.0 delivers algorithmic and systems advances intended to reduce cost and improve utilization: enhanced attention and reasoning primitives, sparse mixture-of-experts techniques, and support for FP4, FP6, and FP8 precision formats that trade a bit of accuracy for massive memory savings. ROCm 7.0 also focuses on scale and manageability by enabling GPU-direct communications, distributed inference across nodes with vLLM-d and DeepEP compatibility, and cluster tools such as AMD Resource Manager and a new AI Workbench for orchestration and monitoring. To smooth adoption, AMD provides prebuilt Docker images with quantized model examples and turnkey stacks for common frameworks. AMD is also expanding endpoint support to Ryzen AI processors and Radeon RX series GPUs, so developers can deploy consistent pipelines from edge devices to cloud racks. ROCm 7 is available now through AMD's developer resources, with documentation, examples, and enterprise support to help teams get started.