Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • HACKING
  • SLOT
  • CASINO
  • SUBMIT
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • HACKING
  • SLOT
  • CASINO
  • SUBMIT
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA’s EMBark revolutionizes training large-scale recommender systems.
ADOPTION NEWS

NVIDIA’s EMBark revolutionizes training large-scale recommender systems.

By Crypto FlexsNovember 25, 20242 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA’s EMBark revolutionizes training large-scale recommender systems.
Share
Facebook Twitter LinkedIn Pinterest Email

Ted Hisokawa
November 21, 2024 02:40

NVIDIA introduces EMBark, which optimizes the embedding process to power deep learning recommendation models and significantly increases training efficiency for large-scale systems.





In an effort to increase the efficiency of large-scale recommender systems, NVIDIA introduced EMBark, a new approach that aims to optimize the embedding process of deep learning recommendation models. According to NVIDIA, recommender systems play a central role in the Internet industry, and training them efficiently is a critical task for many companies.

Challenges of training recommendation systems

Deep learning recommendation models (DLRMs) often incorporate billions of identity features and require robust training solutions. Recent advances in GPU technology, such as NVIDIA Merlin HugeCTR and TorchRec, have improved DLRM training by leveraging GPU memory to handle large-scale identity feature embeddings. However, as the number of GPUs increases, the communication overhead during embedding becomes a bottleneck, sometimes accounting for more than half of the total training overhead.

EMBark’s innovative approach

EMBark, presented at RecSys 2024, addresses these challenges by implementing a 3D flexible sharding strategy and communication compression techniques, aiming to balance the load during training and reduce communication time for embedding. The EMBark system includes three core components: an embedding cluster, a flexible 3D sharding scheme, and a sharding planner.

Includes cluster

These clusters promote efficient training by grouping similar features and applying custom compression strategies. EMBark categorizes clusters into data-parallel (DP), reduction-based (RB), and unique-based (UB) types, each suitable for different training scenarios.

Flexible 3D sharding method

This innovative scheme allows precise control of workload balancing across GPUs by leveraging 3D tuples to represent each shard. This flexibility addresses imbalance issues found in traditional sharding methods.

Sharding Planner

The sharding planner uses a greedy search algorithm to determine the optimal sharding strategy and improves the training process based on hardware and embedding configuration.

Performance and Evaluation

The efficiency of EMBark was tested on NVIDIA DGX H100 nodes, demonstrating significant improvements in training throughput. Across a variety of DLRM models, EMBark achieves an average 1.5x increase in training speed, with some configurations being up to 1.77x faster than existing methods.

EMBark significantly improves the efficiency of large-scale recommender system models by strengthening the embedding process, setting a new standard for deep learning recommender systems. To get more detailed insight into EMBark’s performance, you can view its research paper.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

SOL Leverage Longs Jump Ship, is it $ 200 next?

September 24, 2025

Bitcoin Treasury Firm Strive adds an industry veterans and starts a new $ 950 million capital initiative.

September 16, 2025

The best Solana depin project to form the future -Part 2

September 8, 2025
Add A Comment

Comments are closed.

Recent Posts

How to solve the XPL perp defect

September 26, 2025

Detect the full execution bug with the induction pursing of Wake

September 25, 2025

KuCoin Appeals FINTRAC Decision, Reaffirms Commitment To Compliance

September 25, 2025

Phemex Revamps Blog To Deliver Deeper Insights And Enhanced Reader Experience

September 25, 2025

T-REX Launches Intelligence Layer To Fix Web3’s Value Distribution Problem

September 25, 2025

Are you doing a fair deal?

September 25, 2025

The method of transforming ASTER WHALES into panic is as follows.

September 25, 2025

Hyperliquid launches USDH Stablecoin issued by Native Markets

September 25, 2025

Hyperliquid’s USDH Stablecoin is broadcast live at an early transaction volume of $ 2M or more.

September 24, 2025

One All-Powerful Asset Across Two Ecosystems

September 24, 2025

BTCC Exchange Partners With NBA All-Star Jaren Jackson Jr. To Inspire Smarter Moves In Sports And Crypto

September 24, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

How to solve the XPL perp defect

September 26, 2025

Detect the full execution bug with the induction pursing of Wake

September 25, 2025

KuCoin Appeals FINTRAC Decision, Reaffirms Commitment To Compliance

September 25, 2025
Most Popular

Bitcoin ETF sees net inflows of $700 million into IBIT, with FBTC offsetting outflows from GBTC.

February 5, 2024

Maximize your cryptocurrency portfolio with top altcoins expected to surge 10x during the upcoming bull market and Bitcoin ​​halving

April 7, 2024

The Winklevoss twins said they each donated $1 million to Trump’s US presidential campaign.

June 21, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.