Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • SUBMIT
Crypto Flexs
  • DIRECTORY
  • CRYPTO
    • ETHEREUM
    • BITCOIN
    • ALTCOIN
  • BLOCKCHAIN
  • EXCHANGE
  • TRADING
  • SUBMIT
Crypto Flexs
Home»ADOPTION NEWS»NVIDIA Unveils Generative AI-Based Visual AI Agent for Edge Deployments
ADOPTION NEWS

NVIDIA Unveils Generative AI-Based Visual AI Agent for Edge Deployments

By Crypto FlexsJuly 17, 20243 Mins Read
Facebook Twitter Pinterest LinkedIn Tumblr Email
NVIDIA Unveils Generative AI-Based Visual AI Agent for Edge Deployments
Share
Facebook Twitter LinkedIn Pinterest Email

Timothy Morano
July 17, 2024 18:22

NVIDIA powers AI at the edge with Jetson Orin platform, launches Vision Language Models (VLM) for dynamic video analytics





According to the NVIDIA Technical Blog, Vision Language Models (VLM), an exciting innovation in AI technology, provide a more dynamic and flexible way to analyze video. VLM makes the technology more accessible and adaptable by allowing users to interact with image and video inputs using natural language. These models can run on the NVIDIA Jetson Orin edge AI platform or on discrete GPUs via NIM.

What is a Visual AI Agent?

Visual AI agents are powered by VLM, which allows users to ask a wide range of questions in natural language and gain insights that reflect true intent and context from recorded or live video. These agents can be interacted with and integrated with other services and mobile apps via easy-to-use REST APIs. This new generation of visual AI agents helps summarize scenes using natural language, create broad alerts, and extract actionable insights from videos.

NVIDIA Metropolis provides a visual AI agent workflow, a reference solution that accelerates the development of AI applications powered by VLM, extracting insights through contextual understanding from video, whether deployed at the edge or in the cloud.

For cloud deployments, developers can power visual AI agents using NVIDIA NIM, a set of inference microservices that include industry-standard APIs, domain-specific code, optimized inference engines, and enterprise runtimes. Visit the API catalog to explore and try out basic models directly in your browser.

Building Visual AI Agents for the Edge

Jetson Platform Services is a set of pre-built microservices that provide essential built-in capabilities for building computer vision solutions on NVIDIA Jetson Orin. These microservices include AI services that support generative AI models such as zero-shot detection and state-of-the-art VLM. VLM combines large-scale language models with vision transformers to enable complex inference on text and visual inputs.

The VLM of choice for Jetson is VILA, which optimizes tokens per image to deliver cutting-edge inference capabilities and speed. Combining VLM with Jetson Platform Services allows you to create VLM-based visual AI agent applications that detect events on live streaming cameras and send notifications to users via mobile apps.

Integration with mobile apps

The entire end-to-end system can now be integrated with mobile apps to build VLM-based Visual AI Agents. To receive video input for VLM, Jetson Platform Services networking services and VST automatically discover and provide network-connected IP cameras. These cameras are available to VLM services and mobile apps via the VST REST API.

In the app, users can set up custom notifications in natural language, such as “Is there a fire?”, on selected live streams. Once the notification rules are set, VLM evaluates the live stream and notifies the user in real time via a WebSocket connected to the mobile app. This triggers a pop-up notification on the mobile device, allowing the user to ask follow-up questions in chat mode.

conclusion

This development highlights the potential of VLM combined with Jetson Platform Services to build advanced Visual AI agents. The full source code for the VLM AI service is available on GitHub, which developers can use to learn how to use VLM and build their own microservices.

For more information, visit the NVIDIA Technology Blog.

Image source: Shutterstock


Share. Facebook Twitter Pinterest LinkedIn Tumblr Email

Related Posts

AAVE Price Prediction: $100 is the wall. Factors that can destroy or bury a wall include:

July 25, 2026

Multicoin Capital has made its first Hyperliquid ecosystem investment in Trasia, an Asia-focused trading platform.

July 17, 2026

Polymarket Probability Price The probability that the United States will invade Iran before 2027 is 16.5%.

July 9, 2026
Add A Comment

Comments are closed.

Recent Posts

MEXC’s Hacken-Audited November 2026 Proof of Reserves Shows Reserve Ratios Above 100% Across Major Assets

November 19, 2026

My Wallet Introduces 1:1 Cross-Chain Stablecoin Swaps After Being Listed First on WalletConnect

November 19, 2026

The Promo Gaming -Discover Great Sportsbook & Casino Bonuses from Reliable Online Gaming Platforms

November 18, 2026

How to Read Online Gambling Statistics Without Being Misled

November 18, 2026

Tria and Noah Bring Bank Transfers Directly to Self-Custodial Wallets With Automatic EUR-to-USDC Conversion

November 18, 2026

Ondo Stocks to Launch ANTon with 24/7 Mint and Redeem, Live on IPO Day

November 18, 2026

PancakeSwap Rebrands as Pancake Ahead of Mobile App Launch

November 18, 2026

PrimeXBT Launches Anthropic Pre-IPO Crypto Futures, Bringing New Trading Opportunities in AI

November 17, 2026

Xsolla ZK Introduces a Gas Token Designed to Let Digital Items Move Between Games and Players

November 17, 2026

Synthesys Announces Collaboration with WisdomTree Following Registration of Three Tokenized Funds in Singapore

November 17, 2026

Crypto Lending for Businesses From 1% APR

November 17, 2026

Crypto Flexs is a Professional Cryptocurrency News Platform. Here we will provide you only interesting content, which you will like very much. We’re dedicated to providing you the best of Cryptocurrency. We hope you enjoy our Cryptocurrency News as much as we enjoy offering them to you.

Contact Us : Partner(@)Cryptoflexs.com

Top Insights

MEXC’s Hacken-Audited November 2026 Proof of Reserves Shows Reserve Ratios Above 100% Across Major Assets

November 19, 2026

My Wallet Introduces 1:1 Cross-Chain Stablecoin Swaps After Being Listed First on WalletConnect

November 19, 2026

The Promo Gaming -Discover Great Sportsbook & Casino Bonuses from Reliable Online Gaming Platforms

November 18, 2026
Most Popular

ceτi AI Announces Successful Launch of Innovative Decentralized AI Infrastructure Token

March 14, 2024

Earn $200,000 with Option2Trade (O2T) and Shiba Inu (SHIB) in 2024

February 22, 2024

Japan expands VC investment in Web3 companies through cryptocurrency takeover bill

February 19, 2024
  • Home
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms and Conditions
© 2026 Crypto Flexs

Type above and press Enter to search. Press Esc to cancel.