• Competitor rules

    Please remember that any mention of competitors, hinting at competitors or offering to provide details of competitors will result in an account suspension. The full rules can be found under the 'Terms and Rules' link in the bottom right corner of your screen. Just don't mention competitors in any way, shape or form and you'll be OK.

NVIDIA RTX Broadcast Engine Brings AI Enhancements To Livestreams

Gregster

Gregster

Gregster

Caporegime
Joined
24 Sep 2008
Posts
38,284
Location
Essex innit!
The new RTX Broadcast Engine SDKs include:

  • RTX Greenscreen, to deliver real-time background removal of a webcam feed, so only your face and body show up on the livestream. The RTX Greenscreen AI model understands which part of an image is human and which is background, so gamers get the benefits of a greenscreen without needing to buy one.
  • RTX AR, which can detect faces, track facial features such as eyes and mouth, and even model the surface of a face, enabling real-time augmented reality effects using a standard web camera. Developers can use it to create fun, engaging AR effects, such as overlaying 3D content on a face or allowing a person to control 3D characters with their face.
  • RTX Style Filters, which use an AI technique called style transfer to transform the look and feel of a webcam feed based on the style of another image. With the press of a hotkey, you can style your video feed with your favorite painting or game art.
NVIDIA has partnered with OBS for integrating their RTX Greenscreen right into OBS and will be showing it off at TwitchCon for those in attendance who want to see how effective it is before it is rolled out to the general audience in the coming months.

In addition to the RTX Broadcast Engine, we’ve recently seen several of the top software teams roll out support for the new NVIDIA Video Codec SDK. Elgato has used it for their new 4K60 Pro MK2 capture card and Discord as well for game streaming right from their app. The other big integration is through Twitch themselves with their TwitchStudio which I just got access too and will be visiting that in the coming days.

It has been and continues to be interesting to see NVIDIA find new and useful ways to tap into the hardware features that the RTX cards bring to the table and will be interesting to check some of these features out for myself when they become available.
Click to expand...

https://wccftech.com/nvidia-rtx-broadcast-engine-brings-ai-enhancements-to-livestreams/

Soundsa pretty awesome to me and live broadcasting without the background in is awesome stuff
 
Some will say NVIDIA fluff, but as usual when AMD copy it with a not so good open source version, it will suddenly be a better than sliced bread feature.;)
 
That face mesh technology could be very good for MMOs and adventure games (like The Witcher & Tomb Raider) so that faces and lips of both PCs and NPCs sync with speech. And remember Gollum's powerful soliloquy in The Two Towers? That's now possible for the amateur animator.
 
You must log in or register to reply here.
Back
Top Bottom