Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration
ADOPTION NEWS

NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration

By Crypto FlexsSeptember 18, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration
Share
Facebook Twitter LinkedIn Pinterest Email

Wang Long Chai
18 Sep 2024 04:50

NVIDIA and Oracle collaborate to accelerate AI workloads and improve generative AI applications using NVIDIA NIM and cuVS on Oracle Cloud Infrastructure.





Much of the world’s data is still untapped, and companies are looking to create next-generation generative AI applications to extract value from this data. According to the NVIDIA Tech Blog, the Augmented Search Generation (RAG) pipeline is a key part of this, allowing users to interact with massive amounts of data and transform documents into conversational AI applications.

Challenges of implementing the RAG pipeline

Enterprises face several challenges when implementing RAG pipelines. Handling both structured and unstructured data is complex, processing and searching the data is computationally intensive, and these pipelines must also incorporate privacy and security.

To address these challenges, NVIDIA and Oracle have collaborated to demonstrate how different segments of the RAG pipeline can leverage the NVIDIA accelerated computing platform on Oracle Cloud Infrastructure (OCI). This integration aims to help enterprises better leverage their data to improve the quality and reliability of their generated AI output.

Generating Embeddings Using NVIDIA GPUs and Oracle Autonomous Database

In data-rich enterprise environments, leveraging massive amounts of text data for AI is critical to driving efficiency and productivity. NVIDIA and Oracle have demonstrated how customers can access NVIDIA GPUs via Oracle Machine Learning (OML) Notebooks in Autonomous Database. This allows users to load data directly from Oracle Database tables into an OCI NVIDIA GPU-accelerated virtual machine (VM) instance, generate vector embeddings using GPUs, and store those vectors in Oracle Database for efficient searching using AI vector search.

Accelerated Vector Search Index and Oracle Database 23ai

NVIDIA cuVS is an open source library for GPU-accelerated vector search and clustering. A key feature of cuVS is its ability to significantly improve index build times, a critical component of vector search. NVIDIA and Oracle have demonstrated a proof of concept that accelerates vector index builds for the Hierarchical Navigable Small World (HNSW) algorithm. This approach combines GPUs and CPUs to make index creation faster and improve the performance of AI workloads.

High-Performance LLM Inference Using NIM in OCI

NVIDIA NIM provides containers that self-host GPU-accelerated inference microservices for pre-trained and custom AI models in a variety of environments. NIM microservices are designed for NVIDIA accelerated infrastructure, allowing for seamless integration with existing tools and applications. Developers can quickly deploy LLMs with minimal code on-premises or in Kubernetes-managed cloud environments.

Deploying NVIDIA NIM on OCI offers several benefits, including improved total cost of ownership (TCO) with low-latency, high-throughput inference, faster time to market with pre-built microservices, and greater security and control of applications and data.

In an Oracle CloudWorld demo, NVIDIA and Oracle demonstrated how NIM for LLM can achieve higher throughput than existing open source alternatives, especially for text generation and translation use cases.

Get started

NVIDIA, in collaboration with OCI and the Oracle Database team, demonstrated how to use NVIDIA GPUs and software to accelerate the bulk generation of vector embeddings, HNSW index creation, and inference elements. This approach helps organizations leverage the performance gains available on NVIDIA accelerated computing platforms to leverage AI to manage massive amounts of data stored in Oracle databases.

Learn more about cuVS. To try out NVIDIA NIM, visit ai.nvidia.com and join the NVIDIA Developer Program to get immediate access to microservices. You can also use NVIDIA GPU-enabled notebooks with Autonomous Database and Oracle Database 23ai AI Vector Search using Oracle Database 23ai Free.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Algorand (Algo) Get momentum in the launch and technical growth.

July 14, 2025

It flashes again in July

July 6, 2025

Stablecoin startups surpass 2021 venture capital peaks as institutional money spills.

June 28, 2025
Add A Comment

Comments are closed.

Recent Posts

MultiBank Group To List $MBG Token On Gate.io And MEXC During Official Token Generation Event

July 18, 2025

Earn $4,777 Daily! PaxMining Leads 2025’s Record-Breaking Bitcoin Mining Boom

July 18, 2025

GSR Leads $100M Private Placement Into Nasdaq-listed MEI Pharma To Launch First Institutional Litecoin Treasury Strategy Alongside Charlie Lee

July 18, 2025

KuCoin Launches XStocks, Delivering A One-Stop Access Point To Top Global Tokenized Equities

July 18, 2025

💵 FREE $18 USDT – Just For Signing Up!

July 18, 2025

How Does AIXA Mining Break Traditional Barriers?

July 18, 2025

How Does AIXA Mining Break Traditional Barriers?

July 18, 2025

The future of EF ecosystem development

July 18, 2025

Satoshi-Aera Bitcoin Whale moves another 40K BTC to Galaxy Digital.

July 18, 2025

Behind The Surge In XRP, DLMining Brings New Opportunities To Mine BTC With Your XRP

July 18, 2025

The strategy has hit the highest market cap since the Rally Bitcoin rally.

July 17, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

MultiBank Group To List $MBG Token On Gate.io And MEXC During Official Token Generation Event

July 18, 2025

Earn $4,777 Daily! PaxMining Leads 2025’s Record-Breaking Bitcoin Mining Boom

July 18, 2025

GSR Leads $100M Private Placement Into Nasdaq-listed MEI Pharma To Launch First Institutional Litecoin Treasury Strategy Alongside Charlie Lee

July 18, 2025
Most Popular

The risk of XRP drops by 30%, which failed to support $ 2.20 -analyst failed

February 12, 2025

Solana decentralized exchange altcoin surges more than 400% on Friday after listing on new exchange

November 10, 2024

Ripple CTO to reveal 2024 strategy at ETH Denver

February 27, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.