Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • SUBMIT
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • SUBMIT
Crypto Flexs
Home»ADOPTION NEWS»AMD Launches AMD-135M: Innovation in Small Language Models
ADOPTION NEWS

AMD Launches AMD-135M: Innovation in Small Language Models

By Crypto FlexsSeptember 28, 20242 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
AMD Launches AMD-135M: Innovation in Small Language Models
Share
Facebook Twitter LinkedIn Pinterest Email

Louisa Crawford
September 28, 2024 07:13

AMD unveiled the AMD-135M, the first compact language model with speculative decoding to improve AI model efficiency and performance.





In a significant advancement in artificial intelligence, AMD announced the release of AMD-135M, its first small language model (SLM). According to AMD.com, this new model aims to address some of the limitations faced by large language models (LLMs) such as GPT-4 and Llama while providing specialized functionality.

AMD-135M: The first AMD small language model

Part of the Llama family, the AMD-135M is AMD’s pioneering effort in SLM. The model was trained from scratch using the AMD Instinct™ MI250 accelerator and 670 billion tokens. The training process resulted in two different models: AMD-Llama-135M and AMD-Llama-135M-code. The former was pre-trained with regular data, while the latter was fine-tuned with an additional 20 billion tokens specifically for code data.

prior training: AMD-Llama-135M was trained for 6 days using 4 MI250 nodes. The AMD-Llama-135M code, a code-centric variant, required an additional four days for fine-tuning.

All associated training code, datasets, and model weights are open source, allowing developers to reproduce the model and contribute to the training of other SLMs and LLMs.

Optimization through speculative decoding

One notable advancement in AMD-135M is the use of speculative decoding. Existing autoregressive approaches for large-scale language models often have low memory access efficiency because each forward pass produces only a single token. Speculative decoding solves this problem by using a small draft model to generate candidate tokens and then verifying them with a larger target model. This method allows generating multiple tokens per forward pass, significantly improving memory access efficiency and inference speed.

Accelerate inference performance

AMD tested the performance of the AMD-Llama-135M code with a draft model of CodeLlama-7b on a variety of hardware configurations, including MI250 accelerators and Ryzen™ AI processors. The results show that inference performance is significantly improved when using speculative decoding. This enhancement establishes an end-to-end workflow for training and inference on selected AMD platforms.

next steps

AMD aims to foster innovation within the AI ​​community by providing open source reference implementations. The company encourages developers to explore and contribute to new areas of AI technology.

For more information about the AMD-135M, visit the full technology blog on AMD.com.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Crypto Exchange Rollish is expanded to 20 by NY approved.

October 2, 2025

SOL Leverage Longs Jump Ship, is it $ 200 next?

September 24, 2025

Bitcoin Treasury Firm Strive adds an industry veterans and starts a new $ 950 million capital initiative.

September 16, 2025
Add A Comment

Comments are closed.

Recent Posts

Phemex Launches Market Confidence Campaign To Support Traders Through Volatility

October 11, 2025

How SJMine Transforms Daily Crypto News Into Passive Profits

October 11, 2025

Ethereum price plunge creates opportunity for 13% rebound

October 11, 2025

Eightco Holdings Inc. ($ORBS) Expands Its Strategic Vision Into The Enterprise

October 10, 2025

Whale.io Launches Battlepass Season 3, Featuring $77,000 In Crypto Casino Rewards

October 10, 2025

Strengthening the AI ​​Agent Economy

October 10, 2025

‘OG’ Whale Attracts Over $400 Million in Bearish BTC Bet

October 10, 2025

Rhuna Raises $2M Seed Round Led by Aptos Labs to Build Stablecoin Payment Infrastructure for Entertainment

October 10, 2025

Mobile App Change Log 7.17.0

October 9, 2025

Building Tomorrow’s Wealth With Tokenized Gold

October 9, 2025

Dreamcash Celebrates 100,000 Waitlist Signups With Exclusive $50k Giveaway Series

October 9, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Phemex Launches Market Confidence Campaign To Support Traders Through Volatility

October 11, 2025

How SJMine Transforms Daily Crypto News Into Passive Profits

October 11, 2025

Ethereum price plunge creates opportunity for 13% rebound

October 11, 2025
Most Popular

Vitalik Buterin announces Ethereum’s upcoming milestones: Verkle Trees and record expiration.

March 14, 2024

NVIDIA launches security AI general availability through improved protection for large language models.

April 24, 2025

TVVIN takes real-world asset tokenization to the next level.

May 28, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.