Nvidia’s New RTX Broadcast Engine Features AI-Powered Green Scre
Nvidia’s latest RTX-series GPUs are the first to feature real-time ray tracing, which can make games look prettier than ever. However, they’re also powerful computing platforms for AI development. Nvidia has demoed a new AI application powered by the Tensor Cores in RTX cards called RTX Broadcast Engine. Among other things, the new Broadcast Engine can clip the background out of a video feed to create an artificial “green screen.”
RTX Greenscreen is similar to features integrated with select webcams from Logitech C922x and Razer Stargazer, but Nvidia’s solution should work with any video feed. Those webcams with custom background removal tend not to work very well anyway. If Nvidia’s solution works well, it could make those devices much less attractive.
The RTX Broadcast Engine also features a face-tracking augmented reality (AR) feature called RTX AR. It recognizes faces with enough detail to map your features and render them on a 3D model. Again, this feature is similar to what you can get with specific pieces of hardware like the iPhone. That device uses IR dots and special cameras to map your face and produce “Animoji” versions of your face. Nvidia doesn’t need real depth data — the GPU just figures it out with AI.
Finally, there are RTX Style Filters, which use AI to apply filters to a full video. The idea here is you can use the Broadcast Engine to match the style of a game or artwork. In the demo video, Nvidia applies a “Starry Night” filter to a video in real-time. We don’t know how well this will be able to match the look of a game, but it could make for some cool streaming effects.
Developers can apply for early access to the RTX Broadcast Engine right now on Nvidia’s site. It will roll out to everyone “in the coming months.” Nvidia is also working with the makers of popular streaming software OBS to integrate the RTX Greenscreen feature.
Continue reading
BBC Resurrects Shortwave Broadcasts to Reach Russia
Shortwave radio is best known for its role in WWII, but it was most popular during the Cold War. Neither of these facts are comforting.
Google Assistant Gets Clock App Integration, Broadcast Replies, and More
Google is making changes to broadcasts, smart display info cards, routines, and even the Google Clock app. The new features are rolling out right now to your Assistant devices.
The First 8K TV Broadcast Has Officially Taken Place
The first-ever 8K broadcast has officially occurred, but don't expect immediate uptake.