Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • SUBMIT
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • SUBMIT
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA Explores RAPIDS cuVS IVF-PQ for Accelerated Vector Search
ADOPTION NEWS

NVIDIA Explores RAPIDS cuVS IVF-PQ for Accelerated Vector Search

By Crypto FlexsJuly 18, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA Explores RAPIDS cuVS IVF-PQ for Accelerated Vector Search
Share
Facebook Twitter LinkedIn Pinterest Email

Jack Anderson
18 July 2024 20:12

NVIDIA Researches RAPIDS cuVS IVF-PQ Algorithm to Improve Vector Search Performance with Compression and GPU Acceleration





In a detailed blog post, NVIDIA provides insight into the RAPIDS cuVS IVF-PQ algorithm, which aims to accelerate vector search by leveraging GPU technology and advanced compression techniques. This is the first part of a two-part series that follows our previous exploration of the IVF-Flat algorithm.

Introduction to the IVF-PQ Algorithm

In this blog post, we introduce IVF-PQ (Inverted File Index with Product Quantization), an algorithm designed to improve search performance and reduce memory usage by storing data in a compressed form. However, this method comes at the expense of accuracy, a trade-off that we will explore in more detail in the second part of the series.

IVF-PQ builds on the concept of IVF-Flat, which uses an inverted file index to limit search complexity to smaller subsets of data through clustering. Product Quantization (PQ) adds a compression layer by encoding the database vectors, making the process more efficient for large data sets.

Performance Benchmarks

NVIDIA shared benchmarks using the DEEP dataset, which contains 1 billion records and 96 dimensions, and is 360GiB in size. A typical IVF-PQ configuration compresses it to a 54GiB index without much impact on search performance, or as little as 24GiB with a slight slowdown. This compression allows the index to fit into GPU memory.

Comparing with the widely used CPU algorithm HNSW on a 100 million-item subset of the DEEP dataset, we show that cuVS IVF-PQ can significantly accelerate both index building and vector search.

Algorithm Overview

IVF-PQ follows a two-step process: coarse search and precise search. The coarse search is the same as IVF-Flat, but the precise search calculates the distance between the query point and the vector of the explored cluster, but the vector is stored in a compressed format.

This compression is achieved by PQ, which approximates vectors using two-stage quantization. This allows IVF-PQ to fit more data into GPU memory, improving memory bandwidth utilization and accelerating the search process.

Optimization and Performance

NVIDIA has implemented several optimizations in cuVS to ensure that the IVF-PQ algorithm performs efficiently on GPUs. These include:

  • Fuse tasks to reduce output size and optimize memory bandwidth utilization.
  • When possible, store lookup tables (LUTs) in GPU shared memory for faster access.
  • Use custom 8-bit floating point data types in LUTs for faster data conversion.
  • To optimize data transfer, data is aligned in 16-byte chunks.
  • Implement an “early stop” check to avoid unnecessary distance calculations.

NVIDIA benchmarks on a 100 million-size dataset show that IVF-PQ outperforms IVF-Flat, delivering up to 3-4x more queries per second for larger batch sizes.

conclusion

IVF-PQ is a powerful ANN search algorithm that leverages clustering and compression to improve search performance and throughput. The first part of the NVIDIA blog series provides a comprehensive overview of how the algorithm works and its benefits on GPU platforms. For more detailed performance tuning recommendations, NVIDIA encourages readers to explore the second part of the series.

For more information, visit the NVIDIA Technology Blog.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

AAVE Price Prediction: $100 is the wall. Factors that can destroy or bury a wall include:

July 25, 2026

Multicoin Capital has made its first Hyperliquid ecosystem investment in Trasia, an Asia-focused trading platform.

July 17, 2026

Polymarket Probability Price The probability that the United States will invade Iran before 2027 is 16.5%.

July 9, 2026
Add A Comment

Comments are closed.

Recent Posts

BC Game Launches 100 Million $BC Token Bonus Campaign Through Its Live-Market Crashx Game

November 20, 2026

How endpoint monitoring protects the people behind a crypto project

November 20, 2026

Bybit’s Global User Base Surpasses 90 Million as Company Expands Into Traditional Finance

November 20, 2026

Bybit Joins Proof of Talk in Abu Dhabi 2026 as Title Partner and Official Exchange Partner

November 19, 2026

Hashi Mainnet is Live With 20-Plus Partners, Bringing Bitcoin Finance to Sui at Scale

November 19, 2026

MEXC’s Hacken-Audited November 2026 Proof of Reserves Shows Reserve Ratios Above 100% Across Major Assets

November 19, 2026

My Wallet Introduces 1:1 Cross-Chain Stablecoin Swaps After Being Listed First on WalletConnect

November 19, 2026

The Promo Gaming -Discover Great Sportsbook & Casino Bonuses from Reliable Online Gaming Platforms

November 18, 2026

How to Read Online Gambling Statistics Without Being Misled

November 18, 2026

Tria and Noah Bring Bank Transfers Directly to Self-Custodial Wallets With Automatic EUR-to-USDC Conversion

November 18, 2026

Ondo Stocks to Launch ANTon with 24/7 Mint and Redeem, Live on IPO Day

November 18, 2026

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

BC Game Launches 100 Million $BC Token Bonus Campaign Through Its Live-Market Crashx Game

November 20, 2026

How endpoint monitoring protects the people behind a crypto project

November 20, 2026

Bybit’s Global User Base Surpasses 90 Million as Company Expands Into Traditional Finance

November 20, 2026
Most Popular

Coin98 (C98) Super Wallet Teams Up with JamboPhone to Accelerate Web3 Access in Asia

March 14, 2024

Delta Prime DeFi Hacker Exploits Token Minting Bug to Steal $6 Million

September 17, 2024

Bitcoin Bottom is a gate and rendering rendering that opens the door of ‘perhaps’, tone, CRO, MNT at $ 80K.

March 31, 2025
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2026 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.