NVIDIA has launched the latest version of its broadcasting app, which aims to improve the quality of live streaming and remote work through advanced AI-based features. According to the NVIDIA blog, the free application leverages the Tensor Cores of RTX GPUs to deliver professional-grade audio and video enhancements.
stream dream
Historically, high-quality live streaming required expensive hardware setups, often requiring dual PC configurations to handle gaming and encoding separately. NVIDIA Broadcast changes the game by leveraging NVENC, a dedicated hardware video encoder on NVIDIA GPUs that handles the encoding tasks and ensures the rest of the system maintains optimal performance. This innovation is enabling a new wave of broadcasters on platforms like Twitch and YouTube, supported by popular streaming applications like Open Broadcaster Software (OBS).
Additionally, NVIDIA Maxine provides AI-powered features for free, including virtual green screens and webcam-based augmented reality tracking, eliminating the need for expensive physical equipment. These features were first introduced at TwitchCon 2019 and have since been integrated into the NVIDIA Broadcast app.
Now Playing: NVIDIA Broadcast
NVIDIA Broadcast offers a suite of AI-enhanced features designed to improve audio and video quality across a variety of use cases. Some of the key features include:
- Noise and acoustic echo cancellation: AI removes unwanted background noise from both the microphone and incoming audio.
- Virtual background: Features like background removal, replacement, and blur allow users to customize their backgrounds without expensive equipment.
- Eye contact: AI makes it look like the streamer is looking directly at the camera, even when they aren’t.
- Auto Frame: Dynamically tracks movement and automatically crops and zooms in on moving objects.
- illustration: Applies a darkening effect to the corners of the camera image for visual contrast and a stylish flair.
- Video Noise Removal: Removes visual noise in low-light conditions for clearer photos.
This app creates a virtual camera, microphone, or speaker in Windows, allowing users to set up their device once and use it across multiple applications, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex, and Zoom. NVIDIA Broadcast’s AI networks run in real time on dedicated Tensor Cores on NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX, or Quadro RTX GPUs.
The technology behind NVIDIA Broadcast is also available as a software development kit for app developers. Companies like Elgato and independent developers are integrating these AI capabilities into their products, further expanding the scope and usefulness of NVIDIA AI advancements.
(No) To hear is to believe.
NVIDIA Broadcast has been widely adopted since its launch. Twitch celebrity Mr_Vudoo and YouTube host Unmesh Dinda both praised the app’s features. Dinda demonstrated the app’s noise-canceling capabilities in extreme conditions, showing its effectiveness even in loud background noise. Tom’s Hardware editor-in-chief Avram Piltch also tested the app, confirming its ability to filter out a variety of ambient sounds.
NVIDIA Broadcast has also proven useful for remote work. Enhance video calls by providing features like background removal that have been well-received by users in professional environments.
Visit the NVIDIA Broadcast page for more information and to download the app.
Image source: Shutterstock