Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • ADOPTION
  • TRADING
  • HACKING
  • SLOT
  • TRADE
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA’s VISTA-2D model revolutionizes cellular imaging and spatial omics
ADOPTION NEWS

NVIDIA’s VISTA-2D model revolutionizes cellular imaging and spatial omics

By Crypto FlexsJuly 25, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA’s VISTA-2D model revolutionizes cellular imaging and spatial omics
Share
Facebook Twitter LinkedIn Pinterest Email

Jorg Hiller
25 Jul 2024 02:15

NVIDIA presents VISTA-2D, a model that improves cell segmentation and shape clustering in spatial omics, providing a major advance in biology research.





According to the NVIDIA Technical Blog, NVIDIA has unveiled VISTA-2D, a baseline model designed to significantly improve cell segmentation in cellular imaging and spatial omics workflows. The model aims to improve the accuracy of downstream tasks by leveraging advanced image embedding techniques.

Feature Extraction and Clustering

The VISTA-2D model uses an image encoder to generate embeddings that can be converted into segmentation masks. These embeddings provide essential information about cell morphology, enabling accurate cell segmentation. NVIDIA’s blog post explains that these embeddings can be clustered to automatically group cells with similar morphology.

To demonstrate the capabilities of the model, NVIDIA has provided a detailed Jupyter notebook that walks users through the process of segmenting cells and extracting spatial features using VISTA-2D. The notebook also shows how to cluster these features using RAPIDS, creating an automated pipeline for classifying cell types.

Prerequisites and setup

Users interested in exploring the VISTA-2D model will need a basic understanding of Python, Jupyter, and Docker. The Docker container required for this tutorial can be started with the following command:

docker run --rm -it \
    -v /path/to/this/repo/:/workspace \
    -p 8888:8888 \
    --gpus all \
    nvcr.io/nvidia/pytorch:24.03-py3 \
    /bin/bash

Additional Python packages required for the tutorial can be installed using:

pip install -r requirements.txt

Cell segmentation using VISTA-2D

The initial step is to load the VISTA-2D model checkpoint and use it to segment cells in the image. The segmentation process generates a feature vector for each cell, which contains all the information needed to analyze cell morphology. These vectors are then used in a clustering algorithm to group cells with similar features.

cell division

The segmentation function processes cell images via VISTA-2D to generate a segmentation mask that individually labels each cell, allowing for accurate feature extraction for each cell.

img_path="example_livecell_image.tif"
patch, segmentation, pred_mask = segment_cells(img_path, model_ckpt)

Split plotting

The segmented image can be visually verified using the plot_segmentation function, which displays the original image, the segmentation results, and individual masks for each cell.

plot_segmentation(patch, segmentation, pred_mask)
original-cell-image-625x487.png
a) Original cell image
segmentation-625x480.png
b) Segmentation
Individual Mask 625x485.png
c) Individual masks
Figure 2. VISTA-2D segmentation results

Clustering features using RAPIDS

Once the feature vectors are extracted, they are clustered using RAPIDS, a GPU-accelerated machine learning library. The TruncatedSVD algorithm reduces the dimensionality of the feature vectors, making it easier to visualize clusters in 3D space.

dim_red_model = TruncatedSVD(n_components=3)
X = dim_red_model.fit_transform(cell_features)

We then cluster the reduced feature vectors using the DBSCAN algorithm. This method assigns a cluster label to each cell, which can be visualized using Plotly for interactive 3D plots.

model = DBSCAN(eps=0.003, min_samples=2)
labels = model.fit_predict(X)
interactive-3d-diagram.png
Figure 3. Interactive 3D diagram generated from the plot of clustered feature vectors.

conclusion

NVIDIA’s VISTA-2D model provides accurate cell segmentation and feature extraction, providing significant advances in cell imaging and spatial omics. Combined with RAPIDS for clustering, this model efficiently classifies cell types, paving the way for more detailed and automated biological studies.

Image source: Shutterstock






Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

Gala Games improves leader board rewards and introduces preference systems.

June 20, 2025

Ether Leeum Whale starts a $ 11 million leverage betting in the 30% increase in ETH prices.

June 12, 2025

AI starts a cost -effective batch API for LLM request.

June 12, 2025
Add A Comment

Comments are closed.

Recent Posts

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

Bybit Expands Global Reach With Credit Card Crypto Purchases In 25+ Currencies And Cashback Rewards

June 27, 2025

BYDFi Joins Seoul Meta Week 2025, Advancing Web3 Vision And South Korea Strategy

June 27, 2025

Earns $9,800 Per Day With BTC Breaks Through $107,000, GoldenMining Global Market.

June 27, 2025

Why Bakkt Holdings can buy Bitcoin with a $ 1 billion increase

June 27, 2025

NVIDIA RTX strengthens FITY’s AI -centered innovation in Cooler Design.

June 27, 2025

Join Earn Mining To Mine Easily And Earn $7752 A Day

June 26, 2025

Bitcoin prices return to green -building exercise for more profits

June 26, 2025

Weed® Announces Partnership With Khalifa Kush; Launches Global Commercialization

June 26, 2025

GBM Launches Auction Festival With The Sandbox, Aavegotchi, Unstoppable Domains, And More

June 26, 2025

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

CARV’s New Roadmap Signals Next Wave Of Web3 AI

June 27, 2025

Bybit Expands Global Reach With Credit Card Crypto Purchases In 25+ Currencies And Cashback Rewards

June 27, 2025
Most Popular

Understand the BNB Chain’s approach to Maximum Extractable Value (MEV)

October 19, 2024

Crypto trader Michaël van de Poppe says Top-10 Altcoins could see 213% increase, Outlook update on Sui and ChainLink

January 25, 2025

Elon Musk dismisses ‘founding agreement’ lawsuit against OpenAI

June 12, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2025 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.