Jog
April 23, 2025 15:28
NVIDIA announces the general availability of a safe AI solution that focuses on protecting large language models with improved security functions.
NVIDIA officially announced the general availability of security AI solutions, which is a movement to strengthen the security of large language models (LLM) as companies gradually adopt AI for education and reasoning purposes. This presentation, produced by Emily Sakata in NVIDIA Developer Blog, emphasizes the need to protect sensitive data and intellectual property in AI operation.
Improved security function
Secure AI Release introduces some of the main features designed to improve data protection. One of the most prominent features is PPCIE (Protected PCIe) mode, protecting multi -GPU configuration within a confidential virtual machine. This mode is greatly converted to the previous single GPU configuration, providing more powerful security for complex AI workloads.
NVIDIA also removed NV link encryption to improve performance without damage. Changes in proof processes ensure that both GPUs and switches are safely configured in PPCIE mode.
The importance of data security
In today’s digital environment, data security is the most important. Companies create a vast amount of data with significant potential and value. Traditional security measures focused on data motion and rest data, but NVIDIA’s confidential computing (CC) solves the need to be overlooked to protect the data in use. This approach prevents unauthorized access and modifications so that sensitive information is kept safe.
Hardware and software requirements
Security AI solutions are compatible with the NVIDIA H100 and H200 Tenser Core GPUs integrated into the HGX 8-GPU system. For optimal performance, the system must have a CPU that supports reliable execution environment (TEE) such as AMD SEV-SNP and Intel TDX technology.
Supported CPUs include AMD’s EPYC Milan and Genoa series, as well as Intel’s fifth and 6th generation XEON expandable processors. This solution also requires the latest NVIDIA drivers (CUDA 12.8 Data Center Driver) and firmware and is compatible with hypervisors such as Microsoft Azure Hyper-V and KVM. The supported operating system includes Ubuntu 25.04 and Ubuntu 24.04 for AMD.
General availability and resources
When CUDA 12.8 is released, support for PPCIE is generally available, so companies can utilize the overall 8GPU performance by improving the latest security. For more details, NVIDIA provides a wide range of documents and resources and can access directly through the official site.
To get additional information on NVIDIA’s security offering, including a confidential computing solution, stakeholders can explore comprehensive resources available on the NVIDIA Trusted Computing Solutions page.
For more information, visit the NVIDIA Developer blog.
Image Source: Shutter Stock