Ted Hisokawa
23 Aug 2024 14:53
NVIDIA engineers will unveil advancements in Blackwell platform, liquid cooling, and AI-based chip design at Hot Chips 2024.
At the upcoming Hot Chips 2024 conference, NVIDIA engineers will present groundbreaking innovations aimed at improving data center performance and energy efficiency. According to the NVIDIA Blog, the event, scheduled for August 25-27 at Stanford University, will feature four talks by NVIDIA’s senior engineers.
NVIDIA Blackwell Platform
NVIDIA’s presentation highlights the NVIDIA Blackwell platform, which integrates multiple chips, systems, and NVIDIA CUDA software to power next-generation AI applications. The NVIDIA GB200 NVL72, a multi-node liquid cooling solution, is also showcased, featuring 72 Blackwell GPUs and 36 Grace CPUs, setting a new benchmark for AI system design. Additionally, NVLink interconnect technology is discussed for its high throughput and low latency capabilities essential for generative AI.
Advances in liquid cooling
A significant portion of the conference will focus on liquid cooling technologies. Ali Heydari, NVIDIA’s director of data center cooling and infrastructure, will present designs for hybrid-cooled data centers. These designs aim to retrofit existing air-cooled data centers with liquid cooling units, providing a more efficient and space-saving solution. Heydari’s team is also working with the U.S. Department of Energy on the COOLERCHIPS program to develop advanced cooling technologies. Using the NVIDIA Omniverse platform, they are creating a digital twin that models energy consumption and cooling efficiency.
AI-based chip design
NVIDIA is also leveraging AI to improve semiconductor design. Mark Ren, director of design automation research at NVIDIA, will discuss how AI models automate time-consuming tasks to improve design quality and productivity. These models include prediction and optimization tools that help engineers quickly analyze and improve designs. AI agents powered by large-scale language models (LLMs) are being developed to autonomously complete tasks, interact with designers, and learn from databases of human and agent experiences. Ren will share examples of AI applications in timing report analysis, cell cluster optimization, and code generation.
This presentation highlights NVIDIA’s efforts to push the boundaries of data center computing with innovative technologies in AI and cooling solutions. The company’s efforts aim to deliver unparalleled performance, efficiency, and optimization across a range of areas.
Image source: Shutterstock