Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • HACKING
  • SLOT
  • CASINO
  • SUBMIT
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • HACKING
  • SLOT
  • CASINO
  • SUBMIT
Crypto Flexs
Home»ADOPTION NEWS»AMD Launches AMD-135M: Innovation in Small Language Models
ADOPTION NEWS

AMD Launches AMD-135M: Innovation in Small Language Models

By Crypto FlexsSeptember 28, 20242 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
AMD Launches AMD-135M: Innovation in Small Language Models
Share
Facebook Twitter LinkedIn Pinterest Email

Louisa Crawford
September 28, 2024 07:13

AMD unveiled the AMD-135M, the first compact language model with speculative decoding to improve AI model efficiency and performance.





In a significant advancement in artificial intelligence, AMD announced the release of AMD-135M, its first small language model (SLM). According to AMD.com, this new model aims to address some of the limitations faced by large language models (LLMs) such as GPT-4 and Llama while providing specialized functionality.

AMD-135M: The first AMD small language model

Part of the Llama family, the AMD-135M is AMD’s pioneering effort in SLM. The model was trained from scratch using the AMD Instinct™ MI250 accelerator and 670 billion tokens. The training process resulted in two different models: AMD-Llama-135M and AMD-Llama-135M-code. The former was pre-trained with regular data, while the latter was fine-tuned with an additional 20 billion tokens specifically for code data.

prior training: AMD-Llama-135M was trained for 6 days using 4 MI250 nodes. The AMD-Llama-135M code, a code-centric variant, required an additional four days for fine-tuning.

All associated training code, datasets, and model weights are open source, allowing developers to reproduce the model and contribute to the training of other SLMs and LLMs.

Optimization through speculative decoding

One notable advancement in AMD-135M is the use of speculative decoding. Existing autoregressive approaches for large-scale language models often have low memory access efficiency because each forward pass produces only a single token. Speculative decoding solves this problem by using a small draft model to generate candidate tokens and then verifying them with a larger target model. This method allows generating multiple tokens per forward pass, significantly improving memory access efficiency and inference speed.

Accelerate inference performance

AMD tested the performance of the AMD-Llama-135M code with a draft model of CodeLlama-7b on a variety of hardware configurations, including MI250 accelerators and Ryzen™ AI processors. The results show that inference performance is significantly improved when using speculative decoding. This enhancement establishes an end-to-end workflow for training and inference on selected AMD platforms.

next steps

AMD aims to foster innovation within the AI ​​community by providing open source reference implementations. The company encourages developers to explore and contribute to new areas of AI technology.

For more information about the AMD-135M, visit the full technology blog on AMD.com.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Bitcoin Treasury Firm Strive adds an industry veterans and starts a new $ 950 million capital initiative.

September 16, 2025

The best Solana depin project to form the future -Part 2

September 8, 2025

Ether Lee (ETH) tests major support for $ 4,453 after the highest rejection.

August 31, 2025
Add A Comment

Comments are closed.

Recent Posts

MEXC Joins Forces With Lombard Finance (BARD) To Launch $1 Million Prize Pool Extravaganza

September 18, 2025

What is the next after the Fed’s 25bps is cut? Everything you need to know

September 18, 2025

The XRP market value surpasses Shopify, Verizon, and Citigroup. Whales sell 40m coins.

September 18, 2025

Green Hood Contracts Thanksgiving Summary -Ackee Blockchain

September 17, 2025

BetFury Is At SBC Summit Lisbon 2025: Affiliate Growth In Focus

September 17, 2025

FED Mining’s Cloud Mining Platform Is Helping Users Earn $8,800 Per Day, And XRP’s Growth Is Driving Market Enthusiasm.

September 17, 2025

Stablecoin Holdings Drop As Investors Pivot To SOL, XRP, And Altcoins

September 17, 2025

Flipster Partners With WLFI To Advance Global Stablecoin Adoption Through USD1 Integration

September 17, 2025

Zircuit Launches $495K Grants Program To Accelerate Web3 Super Apps

September 16, 2025

Kintsu Launches SHYPE On Hyperliquid

September 16, 2025

New Cryptocurrency Mutuum Finance (MUTM) Raises $15.8M As Phase 6 Reaches 40%

September 16, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

MEXC Joins Forces With Lombard Finance (BARD) To Launch $1 Million Prize Pool Extravaganza

September 18, 2025

What is the next after the Fed’s 25bps is cut? Everything you need to know

September 18, 2025

The XRP market value surpasses Shopify, Verizon, and Citigroup. Whales sell 40m coins.

September 18, 2025
Most Popular

Pantera Capital exec says approval of spot Bitcoin ETF provides ‘significant validation’ for the cryptocurrency.

May 5, 2024

Beginner’s Guide to Cent Slot Machines

March 28, 2024

Bitcoin Price can rally even if the global trade war is angry.

April 8, 2025
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.