Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»Oracle Expands NVIDIA GPU Instances on OCI for AI and Digital Twins
ADOPTION NEWS

Oracle Expands NVIDIA GPU Instances on OCI for AI and Digital Twins

By Crypto FlexsAugust 1, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
Oracle Expands NVIDIA GPU Instances on OCI for AI and Digital Twins
Share
Facebook Twitter LinkedIn Pinterest Email

Terryl Dickey
August 1, 2024 02:03

Oracle Cloud Infrastructure (OCI) now offers NVIDIA L40S GPU bare metal instances to enhance AI and digital twin capabilities.





According to the NVIDIA Blog, Oracle Cloud Infrastructure (OCI) has announced the availability of NVIDIA L40S GPU bare metal instances. This expansion is aimed at meeting the growing demand for advanced technologies such as generative AI, large-scale language models (LLMs), and digital twins.

NVIDIA L40S, now available for order from OCI

The NVIDIA L40S GPU is designed to provide multi-workload acceleration for a wide range of applications, including generative AI, graphics, and video. Featuring fourth-generation Tensor Cores and support for the FP8 data format, it is ideal for training and fine-tuning small- to medium-sized LLMs and performing inference across a wide range of use cases.

For example, a single L40S GPU can generate up to 1.4x more tokens per second than a single NVIDIA A100 Tensor Core GPU in a Llama 3 8B with NVIDIA TensorRT-LLM. The L40S also excels at graphics and media acceleration, making it ideal for advanced visualization and digital twin applications. It delivers up to 3.8x higher real-time ray tracing performance than its predecessor and supports NVIDIA DLSS 3 for faster rendering and smoother frame rates.

OCI will be offering the L40S GPU in the BM.GPU.L40S.4 bare metal compute form factor, featuring four NVIDIA L40S GPUs with 48GB of GDDR6 memory each. This setup includes 7.38TB of local NVMe drives, 112 cores of a 4th generation Intel Xeon CPU, and 1TB of system memory. This configuration eliminates virtualization overhead for high-throughput and latency-sensitive AI or machine learning workloads.

“We chose OCI AI infrastructure with bare metal instances and NVIDIA L40S GPUs for 30% more efficient video encoding,” said Sharon Kamel, CEO of Beamr Cloud. “This reduces storage and network bandwidth consumption by up to 50%, resulting in faster file transfers and improved end-user productivity.”

Single GPU H100 VM coming soon from OCI

OCI will soon be launching a compute virtual machine form factor VM.GPU.H100.1 accelerated by a single NVIDIA H100 Tensor Core GPU. This new offering aims to provide cost-effective, on-demand access to enterprises looking to leverage the power of NVIDIA H100 GPUs for generative AI and high-performance computing (HPC) workloads.

A single H100 GPU can generate over 27,000 tokens per second for Llama 3 8B, delivering up to 4x the throughput of a single A100 GPU at FP16 precision. The VM.GPU.H100.1 shape includes 2 x 3.4TB of NVMe drive capacity, 13 cores of 4th generation Intel Xeon processors, and 246GB of system memory, making it suitable for a wide range of AI tasks.

GH200 bare metal instance available for validation

OCI also provided the BM.GPU.GH200 compute shape for customer testing. This shape features the NVIDIA Grace Hopper Superchip and NVLink-C2C, providing high-bandwidth, cache-coherent 900GB/s connectivity between the NVIDIA Grace CPU and the Hopper GPU. This setup can improve performance by up to 10x for applications running terabytes of data compared to the NVIDIA A100 GPU.

Optimized software for enterprise AI

Maximizing the potential of GPU-accelerated compute instances requires an optimized software layer. NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available on the OCI Marketplace, provides a set of microservices designed to securely and reliably deploy high-performance AI model inference.

NIM pre-built containers optimized for NVIDIA GPUs provide improved cost of ownership, faster time to market, and enhanced security. These microservices can be easily deployed on OCI, enabling enterprises to develop world-class generative AI applications.

For more information, visit the NVIDIA blog.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025

Gala Games improves leader board rewards and introduces preference systems.

June 20, 2025

Ether Leeum Whale starts a $ 11 million leverage betting in the 30% increase in ETH prices.

June 12, 2025
Add A Comment

Comments are closed.

Recent Posts

Checkpoint #4: Berlinterop | Ether Leeum Foundation Blog

June 28, 2025

TRON Price Propects USDT supply exceeded $ 80 billion

June 28, 2025

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025

No Altcoin Season 2025 ? Why Bitcoin Dominance Is Holding Strong In The Crypto Market

June 28, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Safe smart account audit summary

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

Bybit Expands Global Reach With Credit Card Crypto Purchases In 25+ Currencies And Cashback Rewards

June 27, 2025

BYDFi Joins Seoul Meta Week 2025, Advancing Web3 Vision And South Korea Strategy

June 27, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Checkpoint #4: Berlinterop | Ether Leeum Foundation Blog

June 28, 2025

TRON Price Propects USDT supply exceeded $ 80 billion

June 28, 2025

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025
Most Popular

Trump Jr. Launches DeFi Platform, Says $510 Billion in Sales Will Make Crypto Profits Zero by 2024: Finance Redefined

August 10, 2024

Crypto analyst says Uniswap is flashing near-term bullish signals and updates outlook on Cardano.

April 21, 2024

Delta Prime DeFi Hacker Exploits Token Minting Bug to Steal $6 Million

September 17, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.