Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration
ADOPTION NEWS

NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration

By Crypto FlexsSeptember 18, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration
Share
Facebook Twitter LinkedIn Pinterest Email

Wang Long Chai
18 Sep 2024 04:50

NVIDIA and Oracle collaborate to accelerate AI workloads and improve generative AI applications using NVIDIA NIM and cuVS on Oracle Cloud Infrastructure.





Much of the world’s data is still untapped, and companies are looking to create next-generation generative AI applications to extract value from this data. According to the NVIDIA Tech Blog, the Augmented Search Generation (RAG) pipeline is a key part of this, allowing users to interact with massive amounts of data and transform documents into conversational AI applications.

Challenges of implementing the RAG pipeline

Enterprises face several challenges when implementing RAG pipelines. Handling both structured and unstructured data is complex, processing and searching the data is computationally intensive, and these pipelines must also incorporate privacy and security.

To address these challenges, NVIDIA and Oracle have collaborated to demonstrate how different segments of the RAG pipeline can leverage the NVIDIA accelerated computing platform on Oracle Cloud Infrastructure (OCI). This integration aims to help enterprises better leverage their data to improve the quality and reliability of their generated AI output.

Generating Embeddings Using NVIDIA GPUs and Oracle Autonomous Database

In data-rich enterprise environments, leveraging massive amounts of text data for AI is critical to driving efficiency and productivity. NVIDIA and Oracle have demonstrated how customers can access NVIDIA GPUs via Oracle Machine Learning (OML) Notebooks in Autonomous Database. This allows users to load data directly from Oracle Database tables into an OCI NVIDIA GPU-accelerated virtual machine (VM) instance, generate vector embeddings using GPUs, and store those vectors in Oracle Database for efficient searching using AI vector search.

Accelerated Vector Search Index and Oracle Database 23ai

NVIDIA cuVS is an open source library for GPU-accelerated vector search and clustering. A key feature of cuVS is its ability to significantly improve index build times, a critical component of vector search. NVIDIA and Oracle have demonstrated a proof of concept that accelerates vector index builds for the Hierarchical Navigable Small World (HNSW) algorithm. This approach combines GPUs and CPUs to make index creation faster and improve the performance of AI workloads.

High-Performance LLM Inference Using NIM in OCI

NVIDIA NIM provides containers that self-host GPU-accelerated inference microservices for pre-trained and custom AI models in a variety of environments. NIM microservices are designed for NVIDIA accelerated infrastructure, allowing for seamless integration with existing tools and applications. Developers can quickly deploy LLMs with minimal code on-premises or in Kubernetes-managed cloud environments.

Deploying NVIDIA NIM on OCI offers several benefits, including improved total cost of ownership (TCO) with low-latency, high-throughput inference, faster time to market with pre-built microservices, and greater security and control of applications and data.

In an Oracle CloudWorld demo, NVIDIA and Oracle demonstrated how NIM for LLM can achieve higher throughput than existing open source alternatives, especially for text generation and translation use cases.

Get started

NVIDIA, in collaboration with OCI and the Oracle Database team, demonstrated how to use NVIDIA GPUs and software to accelerate the bulk generation of vector embeddings, HNSW index creation, and inference elements. This approach helps organizations leverage the performance gains available on NVIDIA accelerated computing platforms to leverage AI to manage massive amounts of data stored in Oracle databases.

Learn more about cuVS. To try out NVIDIA NIM, visit ai.nvidia.com and join the NVIDIA Developer Program to get immediate access to microservices. You can also use NVIDIA GPU-enabled notebooks with Autonomous Database and Oracle Database 23ai AI Vector Search using Oracle Database 23ai Free.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025

Gala Games improves leader board rewards and introduces preference systems.

June 20, 2025

Ether Leeum Whale starts a $ 11 million leverage betting in the 30% increase in ETH prices.

June 12, 2025
Add A Comment

Comments are closed.

Recent Posts

Looking for an Affordable Crypto PR Agency? Here’s What to Know Before You Spend

July 3, 2025

Crypto PR Packages for Startups: What You Need & How to Choose the Right One

July 3, 2025

Cheap Crypto Press Release: How to Promote Your Project Without Overpaying

July 2, 2025

The Ultimate Guide to Crypto Public Relations Packages

July 2, 2025

Submit Your Website to Crypto Directories and Boost Your Visibility Instantly

July 2, 2025

Cardano (ADA) -It is not damaged, but there is no fireworks that can be moved yet.

July 2, 2025

Verifiable OffChain Compute Framework Powering AI Applications

July 2, 2025

How to Start a Crypto Press Release Side Hustle and Keep 100% Profit (Step-by-Step Guide)

July 2, 2025

Cryptocurrency PR: How to Build Trust and Exposure in Web3

July 2, 2025

WEMADE & Redlab Unleash Web3 MMORPG – Global Pre-Registration Open For Aug 2025

July 2, 2025

Crypto PR: The Ultimate Guide to Public Relations in the Blockchain Era

July 2, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

Looking for an Affordable Crypto PR Agency? Here’s What to Know Before You Spend

July 3, 2025

Crypto PR Packages for Startups: What You Need & How to Choose the Right One

July 3, 2025

Cheap Crypto Press Release: How to Promote Your Project Without Overpaying

July 2, 2025
Most Popular

Bitcoin price rises 5% to $62,000 as U.S. jobs data boosts interest rate cut bets

May 3, 2024

Get back your lost Bitcoin – Bitcoin Stack Exchange

February 28, 2024

As Degens scrambles for BONK, Solana phone sales soar.

December 15, 2023
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.