Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»Oracle Expands NVIDIA GPU Instances on OCI for AI and Digital Twins
ADOPTION NEWS

Oracle Expands NVIDIA GPU Instances on OCI for AI and Digital Twins

By Crypto FlexsAugust 1, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
Oracle Expands NVIDIA GPU Instances on OCI for AI and Digital Twins
Share
Facebook Twitter LinkedIn Pinterest Email

Terryl Dickey
August 1, 2024 02:03

Oracle Cloud Infrastructure (OCI) now offers NVIDIA L40S GPU bare metal instances to enhance AI and digital twin capabilities.





According to the NVIDIA Blog, Oracle Cloud Infrastructure (OCI) has announced the availability of NVIDIA L40S GPU bare metal instances. This expansion is aimed at meeting the growing demand for advanced technologies such as generative AI, large-scale language models (LLMs), and digital twins.

NVIDIA L40S, now available for order from OCI

The NVIDIA L40S GPU is designed to provide multi-workload acceleration for a wide range of applications, including generative AI, graphics, and video. Featuring fourth-generation Tensor Cores and support for the FP8 data format, it is ideal for training and fine-tuning small- to medium-sized LLMs and performing inference across a wide range of use cases.

For example, a single L40S GPU can generate up to 1.4x more tokens per second than a single NVIDIA A100 Tensor Core GPU in a Llama 3 8B with NVIDIA TensorRT-LLM. The L40S also excels at graphics and media acceleration, making it ideal for advanced visualization and digital twin applications. It delivers up to 3.8x higher real-time ray tracing performance than its predecessor and supports NVIDIA DLSS 3 for faster rendering and smoother frame rates.

OCI will be offering the L40S GPU in the BM.GPU.L40S.4 bare metal compute form factor, featuring four NVIDIA L40S GPUs with 48GB of GDDR6 memory each. This setup includes 7.38TB of local NVMe drives, 112 cores of a 4th generation Intel Xeon CPU, and 1TB of system memory. This configuration eliminates virtualization overhead for high-throughput and latency-sensitive AI or machine learning workloads.

“We chose OCI AI infrastructure with bare metal instances and NVIDIA L40S GPUs for 30% more efficient video encoding,” said Sharon Kamel, CEO of Beamr Cloud. “This reduces storage and network bandwidth consumption by up to 50%, resulting in faster file transfers and improved end-user productivity.”

Single GPU H100 VM coming soon from OCI

OCI will soon be launching a compute virtual machine form factor VM.GPU.H100.1 accelerated by a single NVIDIA H100 Tensor Core GPU. This new offering aims to provide cost-effective, on-demand access to enterprises looking to leverage the power of NVIDIA H100 GPUs for generative AI and high-performance computing (HPC) workloads.

A single H100 GPU can generate over 27,000 tokens per second for Llama 3 8B, delivering up to 4x the throughput of a single A100 GPU at FP16 precision. The VM.GPU.H100.1 shape includes 2 x 3.4TB of NVMe drive capacity, 13 cores of 4th generation Intel Xeon processors, and 246GB of system memory, making it suitable for a wide range of AI tasks.

GH200 bare metal instance available for validation

OCI also provided the BM.GPU.GH200 compute shape for customer testing. This shape features the NVIDIA Grace Hopper Superchip and NVLink-C2C, providing high-bandwidth, cache-coherent 900GB/s connectivity between the NVIDIA Grace CPU and the Hopper GPU. This setup can improve performance by up to 10x for applications running terabytes of data compared to the NVIDIA A100 GPU.

Optimized software for enterprise AI

Maximizing the potential of GPU-accelerated compute instances requires an optimized software layer. NVIDIA NIM, part of the NVIDIA AI Enterprise software platform available on the OCI Marketplace, provides a set of microservices designed to securely and reliably deploy high-performance AI model inference.

NIM pre-built containers optimized for NVIDIA GPUs provide improved cost of ownership, faster time to market, and enhanced security. These microservices can be easily deployed on OCI, enabling enterprises to develop world-class generative AI applications.

For more information, visit the NVIDIA blog.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025

Gala Games improves leader board rewards and introduces preference systems.

June 20, 2025

Ether Leeum Whale starts a $ 11 million leverage betting in the 30% increase in ETH prices.

June 12, 2025
Add A Comment

Comments are closed.

Recent Posts

As Nano Labs begins to accumulate $ 1 billion, BNB gets a big supporter.

July 5, 2025

The Complete Guide to Crypto Website Listing Directories

July 5, 2025

Crypto Directories Listing That Will Transform Your Project’s Reach

July 5, 2025

The Ultimate Guide to Hiring a Crypto Marketing Agency

July 5, 2025

Six high upside encryption coins of less than $ 20 are seen in 2025.

July 5, 2025

Valhalla Goes Today: FLOKI has been developed for 3 years and debuts the play MMORPG.

July 4, 2025

The Open Platform Is First Unicorn In Web3 Ecosystem In Telegram At $1bn Valuation

July 3, 2025

The mindset of Retail Investors

July 3, 2025

Cooking.City Bringing Back Value Redistribution To Solana Fair Launches

July 3, 2025

XRP rebounds are interested in APT miners cloud mining.

July 3, 2025

The market will select US regulatory stable coins more than CBDCS every day of CBDCS every day.

July 3, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

As Nano Labs begins to accumulate $ 1 billion, BNB gets a big supporter.

July 5, 2025

The Complete Guide to Crypto Website Listing Directories

July 5, 2025

Crypto Directories Listing That Will Transform Your Project’s Reach

July 5, 2025
Most Popular

Bitcoin could reach $100,000 by the end of the year, Komodo CTO says.

April 19, 2024

OKX launches P2P block trading for bulk cryptocurrency trading

May 17, 2024

Global economic indicators and emerging market risk analysis

February 2, 2025
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.