AMD Launches Ryzen AI Software 1.2 with Enhanced Tools and Features

AMD has unveiled Ryzen AI Software 1.2, the latest version of its AI software designed to provide developers and independent software vendors (ISVs) with a comprehensive environment for building AI-enhanced applications. According to AMD.com, the release aims to maximize the performance benefits of the Ryzen AI APU hardware architecture, which includes the CPU, integrated GPU (iGPU), and neural processing unit (NPU).

New hardware support

The Ryzen AI Software 1.2 update introduces support for new hardware, specifically improving NPU and iGPU integration.

• Enhanced NPU support: The update supports Strix Point NPUs, delivering impressive performance metrics.
• Ryzen AI 9 365 and Ryzen AI 9 HX 370: Up to 50 TOPS
• Ryzen AI 9 HX 375: Up to 55 TOPS
• Improved iGPU integration: Developers can now seamlessly switch between iGPU and NPU depending on their model requirements without having to reinstall software.

Extended model support

Ryzen AI Software 1.2 extends model support within the PyTorch and ONNX frameworks, allowing for both general-purpose and performance-optimized applications.

• LLM Flow Support: Includes support for additional models for experimental and production purposes.
• A general-purpose non-optimized LLM for prototyping, applicable to AMD Ryzen 7040 series, Ryzen 8040 series, and Ryzen AI 300 series.
• Performance-optimized LLM for benchmarking and deployment is now available on AMD Ryzen AI 300 series.

New and improved developer tools

This update also introduces several new tools to improve usability and optimize performance.

• AI Analyzer: A tool to analyze and visualize model compilation and inference profiling.
• Platform/NPU Inspection and Management: The xrt-smi tool integrates functions for AI PC and NPU health checks, NPU verification, and performance level configuration.
• Dynamic Power Management (DPM) integration: Allows developers to adjust the power slider in Windows to a different power profile during NPU inference.
• ONNX Benchmarking Tool: Facilitates performance evaluation and optimization of ONNX-based workflows.
• Smart Installer: Simplify Ryzen AI software setup with one-click installation of the NPU driver.

These updates are part of AMD’s commitment to delivering cutting-edge tools and improvements for AI development on AI PCs. The latest software release emphasizes ease of use, streamlined workflows, open framework support, and resources designed to advance AI capabilities.

For a comprehensive overview of the new features and improvements in the Ryzen AI Software 1.2 release, see AMD’s official release notes.

Image source: Shutterstock