Ted Hisokawa
November 15, 2024 03:04
NVIDIA DOCA 2.9 introduces significant improvements to AI and cloud computing, delivering improved performance, security, and scalability to data centers and developers.
NVIDIA has released DOCA 2.9, a major update to its data center infrastructure framework designed to enhance AI compute fabric and cloud computing infrastructure. According to NVIDIA’s official announcement, this latest release promises significant improvements in performance, security, and scalability.
Advances in AI and Cloud Computing
DOCA 2.9 introduces a comprehensive software framework that leverages hardware acceleration to increase efficiency and performance. This update includes congestion control, telemetry improvements, and support for the NVIDIA Spectrum-X 1.2 reference architecture. This architecture supports massive scale-out, supporting up to 128,000 GPUs in a single fabric, which is critical for AI workloads.
New features in the DOCA telemetry library allow for high-frequency sampling, improving network monitoring for AI-based environments. This provides more detailed insight into network performance, which is essential for optimizing AI workloads.
North-South connectivity and security
This update also focuses on improving North-South cloud computing by strengthening connectivity between cloud resources and external networks. New features, such as the ‘tuned’ performance analysis tool integrated into DOCA Flow, allow users to gain unprecedented insight into network flow configurations.
OVS-DOCA, now generally available, introduces local mirroring capabilities and significant improvements in connection tracking performance, making it a powerful alternative to legacy solutions for modern networking environments.
Advanced security and management tools
DOCA 2.9 also enhances security through enhancements to the DOCA App Shield library and provides advanced container monitoring capabilities for Linux environments. This helps security teams maintain vigilance over containerized workloads.
Additionally, DOCA Management Service (DMS) has reached general availability, providing simplified device management for NVIDIA BlueField DPUs and SuperNICs. This update supports configuration persistence across node reboots, simplifying operations in complex environments.
Future-ready infrastructure
With DOCA 2.9, NVIDIA targets a future-proof data center infrastructure by providing developers with powerful tools to optimize application and data path performance. This release takes a significant step forward in AI and cloud infrastructure development by supporting the transition to DOCA-OFED, a unified networking stack integrated within the DOCA framework.
Image source: Shutterstock