Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • HACKING
  • SLOT
  • CASINO
  • SUBMIT
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • HACKING
  • SLOT
  • CASINO
  • SUBMIT
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA’s EMBark revolutionizes training large-scale recommender systems.
ADOPTION NEWS

NVIDIA’s EMBark revolutionizes training large-scale recommender systems.

By Crypto FlexsNovember 25, 20242 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA’s EMBark revolutionizes training large-scale recommender systems.
Share
Facebook Twitter LinkedIn Pinterest Email

Ted Hisokawa
November 21, 2024 02:40

NVIDIA introduces EMBark, which optimizes the embedding process to power deep learning recommendation models and significantly increases training efficiency for large-scale systems.





In an effort to increase the efficiency of large-scale recommender systems, NVIDIA introduced EMBark, a new approach that aims to optimize the embedding process of deep learning recommendation models. According to NVIDIA, recommender systems play a central role in the Internet industry, and training them efficiently is a critical task for many companies.

Challenges of training recommendation systems

Deep learning recommendation models (DLRMs) often incorporate billions of identity features and require robust training solutions. Recent advances in GPU technology, such as NVIDIA Merlin HugeCTR and TorchRec, have improved DLRM training by leveraging GPU memory to handle large-scale identity feature embeddings. However, as the number of GPUs increases, the communication overhead during embedding becomes a bottleneck, sometimes accounting for more than half of the total training overhead.

EMBark’s innovative approach

EMBark, presented at RecSys 2024, addresses these challenges by implementing a 3D flexible sharding strategy and communication compression techniques, aiming to balance the load during training and reduce communication time for embedding. The EMBark system includes three core components: an embedding cluster, a flexible 3D sharding scheme, and a sharding planner.

Includes cluster

These clusters promote efficient training by grouping similar features and applying custom compression strategies. EMBark categorizes clusters into data-parallel (DP), reduction-based (RB), and unique-based (UB) types, each suitable for different training scenarios.

Flexible 3D sharding method

This innovative scheme allows precise control of workload balancing across GPUs by leveraging 3D tuples to represent each shard. This flexibility addresses imbalance issues found in traditional sharding methods.

Sharding Planner

The sharding planner uses a greedy search algorithm to determine the optimal sharding strategy and improves the training process based on hardware and embedding configuration.

Performance and Evaluation

The efficiency of EMBark was tested on NVIDIA DGX H100 nodes, demonstrating significant improvements in training throughput. Across a variety of DLRM models, EMBark achieves an average 1.5x increase in training speed, with some configurations being up to 1.77x faster than existing methods.

EMBark significantly improves the efficiency of large-scale recommender system models by strengthening the embedding process, setting a new standard for deep learning recommender systems. To get more detailed insight into EMBark’s performance, you can view its research paper.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Ether Lee (ETH) tests major support for $ 4,453 after the highest rejection.

August 31, 2025

Bitcoin analysts bet on $ 200K after hints of Fed.

August 23, 2025

‘Self -transactions, dressed in capital layout’: The cryptocurrency financial craze divides the industry.

August 15, 2025
Add A Comment

Comments are closed.

Recent Posts

Are you ready to token everything?

September 1, 2025

Sign Up And Get $500, Ushering In A New Era Of BTC, XRP, And DOGE Cloud Mining

September 1, 2025

Turning Social Hype Into Token Allocation

September 1, 2025

InFocus Launches Digital Ventures Strategy With Mythos Group To Push Into Blockchain, AI And Bitcoin

September 1, 2025

WorldShards Announces Partnership With ByBit And TGE Date

September 1, 2025

EcoSync & CarbonCore Launch Full Stages Refi Infrastructure Linking Carbon Credits With Web3

September 1, 2025

NFT sales in August increased 2.78% in July 2025

September 1, 2025

Bitcoin Price Posts for 5 consecutive August losses: Will Michael Saylor react?

August 31, 2025

Metaplanet’s bitcoin strategy is having trouble with stock plummet in the crisis of financing.

August 31, 2025

Next chapter of ecosystem support program

August 31, 2025

Ether Lee (ETH) tests major support for $ 4,453 after the highest rejection.

August 31, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Are you ready to token everything?

September 1, 2025

Sign Up And Get $500, Ushering In A New Era Of BTC, XRP, And DOGE Cloud Mining

September 1, 2025

Turning Social Hype Into Token Allocation

September 1, 2025
Most Popular

‘Hong Kong FTX’ victims win lawsuit, banker slams stablecoin: Asia Express

October 31, 2024

SEC’s Paul Atkins pledges defi, self-use support

June 10, 2025

Bitcoin surpasses $44,000. Will this be the next $45 this week?

December 6, 2023
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.