Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA Releases NCCL 2.22, Offering Improved Memory Efficiency and Faster Initialization
ADOPTION NEWS

NVIDIA Releases NCCL 2.22, Offering Improved Memory Efficiency and Faster Initialization

By Crypto FlexsSeptember 21, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA Releases NCCL 2.22, Offering Improved Memory Efficiency and Faster Initialization
Share
Facebook Twitter LinkedIn Pinterest Email

Caroline Bishop
21 Sep 2024 13:38

NVIDIA introduces NCCL 2.22, focusing on memory efficiency, fast initialization, and cost estimation for advanced HPC and AI applications.





The NVIDIA Collective Communications Library (NCCL) has released its latest version, NCCL 2.22, which provides significant improvements aimed at optimizing memory usage, accelerating initialization times, and introducing a cost estimation API. These updates are essential for high-performance computing (HPC) and Artificial Intelligence According to the NVIDIA technology blog, (AI) applications.

Release Highlights

NVIDIA Magnum IO NCCL is designed to optimize inter-GPU and multi-node communication essential for efficient parallel computing. Key features of the NCCL 2.22 release include:

  • Delayed connection setup: This feature allows us to significantly reduce GPU memory overhead by delaying connection creation until it is needed.
  • New API for cost estimation: New APIs help optimize compute and communication redundancy or investigate NCCL cost models.
  • For optimization ncclCommInitRank: Duplicate topology queries are eliminated, resulting in up to 90% faster initialization for applications that create multiple communicators.
  • Multi-subnet support using IB routers: Added communication support for jobs spanning multiple InfiniBand subnets, enabling large-scale DL training jobs.

Detailed features

Lazy connection settings

NCCL 2.22 introduces delayed connection setup, which significantly reduces GPU memory usage by delaying connection creation until it is actually needed. This feature is especially useful for applications with narrow usage, such as repeatedly running the same algorithm. This feature is enabled by default, but can be disabled by setting it. NCCL_RUNTIME_CONNECT=0.

New Cost Model API

New API, ncclGroupSimulateEndHelps developers estimate the time required for a task, helping them optimize computation and communication redundancy. Although the estimates may not perfectly match reality, they provide useful guidance for performance tuning.

Initialization optimization

To minimize initialization overhead, the NCCL team introduced several optimizations, including delayed connection setup and intra-node topology convergence. These improvements can reduce: ncclCommInitRank Applications that create multiple communicators will run significantly faster, with execution times reduced by up to 90%.

New tuner plugin interface

The new tuner plugin interface (v3) provides a 2D cost table per set reporting the estimated time required for the task. This allows external tuners to optimize the combination of algorithms and protocols for better performance.

Static plugin linking

For convenience and to avoid loading problems, NCCL 2.22 supports static linking of network or tuner plugins. Applications can specify this by setting: NCCL_NET_PLUGIN or NCCL_TUNER_PLUGIN to STATIC_PLUGIN.

Group semantics for interruption or destruction

NCCL 2.22 introduces group semantics. ncclCommDestroy and ncclCommAbortAllows multiple communicators to be destroyed simultaneously. This feature aims to prevent deadlocks and improve user experience.

IB Router Support

This release allows NCCL to operate across multiple InfiniBand subnets, improving communications in large networks. The library automatically detects and establishes connections between endpoints across multiple subnets using FLID for higher performance and adaptive routing.

Bug fixes and minor updates

The NCCL 2.22 release also includes several bug fixes and minor updates.

  • For support allreduce Tree algorithm on DGX Google Cloud.
  • Logging NIC names for IB asynchronous errors.
  • Improved performance of registered send and receive operations.
  • Added infrastructure code for NVIDIA Trusted Computing solutions.
  • Provides separate traffic classes for IB and RoCE control messages to support advanced QoS.
  • Supports PCI peer-to-peer communication between partitioned Broadcom PCI switches.

summation

The NCCL 2.22 release introduces several important features and optimizations to improve the performance and efficiency of HPC and AI applications. Improvements include a new tuner plugin interface, support for static linking of plugins, and improved group semantics to prevent deadlocks.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Algorand (Algo) Get momentum in the launch and technical growth.

July 14, 2025

It flashes again in July

July 6, 2025

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025
Add A Comment

Comments are closed.

Recent Posts

Little PEPE surpasses $ 4 million in pre -sales, emerging as one of the main memes in 2025.

July 21, 2025

Bitcoin Price $ 123K Explosion -Trader Brace for Brake Out

July 20, 2025

Ether Lee Rium breaks $ 3K with 7,200% of the virus L2 coin eyes.

July 20, 2025

XRP Breaks Through $3.5! DL Mining Launches AI Cloud Mining Contracts, Earning Steady Profits Every Day

July 20, 2025

AAVE gains strength as AAVE dominates defect loans with net deposits of $ 50B or more.

July 19, 2025

As XRP Surges, DLMining Platform Opens New High-yield Cloud Mining Opportunities For Holders

July 19, 2025

Missed Out On Bitcoin At $9999? SIM Mining Cloud Mining Brings You New Opportunities For Wealth!

July 19, 2025

NFT is a rebound -there is a teenage NFTS this week.

July 19, 2025

MultiBank Group To List $MBG Token On Gate.io And MEXC During Official Token Generation Event

July 18, 2025

Earn $4,777 Daily! PaxMining Leads 2025’s Record-Breaking Bitcoin Mining Boom

July 18, 2025

GSR Leads $100M Private Placement Into Nasdaq-listed MEI Pharma To Launch First Institutional Litecoin Treasury Strategy Alongside Charlie Lee

July 18, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Little PEPE surpasses $ 4 million in pre -sales, emerging as one of the main memes in 2025.

July 21, 2025

Bitcoin Price $ 123K Explosion -Trader Brace for Brake Out

July 20, 2025

Ether Lee Rium breaks $ 3K with 7,200% of the virus L2 coin eyes.

July 20, 2025
Most Popular

Vechain is a crawling for the Renaissance upgrade among the veterinarian price pressure.

June 4, 2025

Betting on the U.S. presidential race totals about $4 billion on Election Day.

November 5, 2024

Northstake partners with Keyrock to strengthen liquidity in ETH validator market

November 17, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.