Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration
ADOPTION NEWS

NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration

By Crypto FlexsSeptember 18, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA and Oracle Enhance AI Workloads with NIM and cuVS Integration
Share
Facebook Twitter LinkedIn Pinterest Email

Wang Long Chai
18 Sep 2024 04:50

NVIDIA and Oracle collaborate to accelerate AI workloads and improve generative AI applications using NVIDIA NIM and cuVS on Oracle Cloud Infrastructure.





Much of the world’s data is still untapped, and companies are looking to create next-generation generative AI applications to extract value from this data. According to the NVIDIA Tech Blog, the Augmented Search Generation (RAG) pipeline is a key part of this, allowing users to interact with massive amounts of data and transform documents into conversational AI applications.

Challenges of implementing the RAG pipeline

Enterprises face several challenges when implementing RAG pipelines. Handling both structured and unstructured data is complex, processing and searching the data is computationally intensive, and these pipelines must also incorporate privacy and security.

To address these challenges, NVIDIA and Oracle have collaborated to demonstrate how different segments of the RAG pipeline can leverage the NVIDIA accelerated computing platform on Oracle Cloud Infrastructure (OCI). This integration aims to help enterprises better leverage their data to improve the quality and reliability of their generated AI output.

Generating Embeddings Using NVIDIA GPUs and Oracle Autonomous Database

In data-rich enterprise environments, leveraging massive amounts of text data for AI is critical to driving efficiency and productivity. NVIDIA and Oracle have demonstrated how customers can access NVIDIA GPUs via Oracle Machine Learning (OML) Notebooks in Autonomous Database. This allows users to load data directly from Oracle Database tables into an OCI NVIDIA GPU-accelerated virtual machine (VM) instance, generate vector embeddings using GPUs, and store those vectors in Oracle Database for efficient searching using AI vector search.

Accelerated Vector Search Index and Oracle Database 23ai

NVIDIA cuVS is an open source library for GPU-accelerated vector search and clustering. A key feature of cuVS is its ability to significantly improve index build times, a critical component of vector search. NVIDIA and Oracle have demonstrated a proof of concept that accelerates vector index builds for the Hierarchical Navigable Small World (HNSW) algorithm. This approach combines GPUs and CPUs to make index creation faster and improve the performance of AI workloads.

High-Performance LLM Inference Using NIM in OCI

NVIDIA NIM provides containers that self-host GPU-accelerated inference microservices for pre-trained and custom AI models in a variety of environments. NIM microservices are designed for NVIDIA accelerated infrastructure, allowing for seamless integration with existing tools and applications. Developers can quickly deploy LLMs with minimal code on-premises or in Kubernetes-managed cloud environments.

Deploying NVIDIA NIM on OCI offers several benefits, including improved total cost of ownership (TCO) with low-latency, high-throughput inference, faster time to market with pre-built microservices, and greater security and control of applications and data.

In an Oracle CloudWorld demo, NVIDIA and Oracle demonstrated how NIM for LLM can achieve higher throughput than existing open source alternatives, especially for text generation and translation use cases.

Get started

NVIDIA, in collaboration with OCI and the Oracle Database team, demonstrated how to use NVIDIA GPUs and software to accelerate the bulk generation of vector embeddings, HNSW index creation, and inference elements. This approach helps organizations leverage the performance gains available on NVIDIA accelerated computing platforms to leverage AI to manage massive amounts of data stored in Oracle databases.

Learn more about cuVS. To try out NVIDIA NIM, visit ai.nvidia.com and join the NVIDIA Developer Program to get immediate access to microservices. You can also use NVIDIA GPU-enabled notebooks with Autonomous Database and Oracle Database 23ai AI Vector Search using Oracle Database 23ai Free.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Gala Games improves leader board rewards and introduces preference systems.

June 20, 2025

Ether Leeum Whale starts a $ 11 million leverage betting in the 30% increase in ETH prices.

June 12, 2025

AI starts a cost -effective batch API for LLM request.

June 12, 2025
Add A Comment

Comments are closed.

Recent Posts

No Altcoin Season 2025 ? Why Bitcoin Dominance Is Holding Strong In The Crypto Market

June 28, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Safe smart account audit summary

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

Bybit Expands Global Reach With Credit Card Crypto Purchases In 25+ Currencies And Cashback Rewards

June 27, 2025

BYDFi Joins Seoul Meta Week 2025, Advancing Web3 Vision And South Korea Strategy

June 27, 2025

Earns $9,800 Per Day With BTC Breaks Through $107,000, GoldenMining Global Market.

June 27, 2025

Why Bakkt Holdings can buy Bitcoin with a $ 1 billion increase

June 27, 2025

NVIDIA RTX strengthens FITY’s AI -centered innovation in Cooler Design.

June 27, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

No Altcoin Season 2025 ? Why Bitcoin Dominance Is Holding Strong In The Crypto Market

June 28, 2025

Why It Matters For Every Crypto Investor

June 27, 2025

Why It Matters For Every Crypto Investor

June 27, 2025
Most Popular

Ripple’s unlock of 500 million XRP escrow threatens price as bulls struggle to hold $0.61

April 12, 2024

New York AG Opposes DCG, Silbert’s Move to Dismiss Fraud Cases

June 8, 2024

Monero fell 6% in 24 hours on OKX across 20 trading pairs.

December 31, 2023
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.