Viz Artist User Guide

Version 5.1 | Published October 31, 2023 ©

To Setup Precision Keyer

Sample

Key FOREGROUND Asset

The Precision Keyer can work on foreground assets (SCENE > Foreground) or on texture which are used within the scene.

images/download/attachments/134794994/background.jpg

Virtual Studio

images/download/attachments/134794994/00_native_input.jpg

Live input as FOREGROUND asset

images/download/attachments/134794994/08_final1_with_background.jpg

Result with configured the Precision Keyer

Key Textures in Scene Tree

If used within the scene, simply drag the media asset in the scene tree and enable the Keyer. Do not add any geometries (for example, Rectangle) on the container!

images/download/attachments/134794994/vss_background_vizrttv.jpg

Virtual Studio

images/download/attachments/134794994/vss_with_clip_as_texture.jpg

Live input added as texture in the scene

images/download/attachments/134794994/vss_with_clip_and_keyed.jpg


Result with configured the Precision Keyer

Prerequisites

The Precision Keyer works on live inputs (including streams and NDI) and clips. The asset must be used as a texture in the scene (either in the scene tree, or as "FOREGROUND" in the scene), and it requires a solid background color which is either green or blue.

images/download/attachments/134794994/00_native_input.jpg

As a first step, select the color mode which should be used by the Keyer, which is either Greenscreen (default) or Bluescreen.

images/download/thumbnails/134794994/image2021-4-28_13-35-52.png

Then, you need to adjust the base parameters of the Keyer. This can be done either by using the Auto Adjust functionality or manually.

NDI

If you want to use the Precision Keyer with active NDI output in a VS setup, please be aware that Viz Engine puts the matte of the Keyer on the key signal. Depending on the device which is used to read the NDI signal, this key might be already applied and thus Virtual Studio elements are not visible on the NDI output. To fix this, you need a fullscreen key or a device that shows fill (RGB) independently from the key (Alpha). To enforce Viz Engine to send a fullscreen key, set NdiOut1.ContainsAlpha = 0 in the configuration file.

Automatic Adjustment of Base Parameters

Use the auto adjust functionality of Viz Engine. The result looks like this:

images/download/attachments/134794994/autoadjust_with_background.jpg

The auto adjustment uses the current input signal to calculate:

  • Hue Adjust

  • White Point (Transparency)

  • Processed FG / RGB

Furthermore, it sets the following values based on some well-proven defaults:

  • Black Point (Opacity)

  • CMY Gain

  • BG Lightwrap

  • Radius/Sharpen of Matte Denoise

However, there still might be the need to slightly adapt the parameters, depending on your input signal.

Manual Setup of Base Parameters

Hue Adjust

images/download/thumbnails/134794994/image2021-4-27_10-23-20.png

The Keyer works best if the background is perfect green (RGB(0, 255, 0)) or perfect blue (RGB(0, 0, 255)). As this is not what we have in most real-world setups, you need to color-shift the input signal until you get perfect green or perfect blue.

Enable the Matte view and adjust the hue shift until you have the maximum of contrast you can get. In perfect scenarios, this would mean that you get a full white background, and a opaque black foreground. Depending on your lighting situation, you will not get perfect white and black on the matte view, this is handled in the next steps. Try to find the hue shift which is the best you can get now, and use 100% for the white point (Transparency) and 0% for the black point (Opacity) to see the unscaled values while adjusting the hue shift.

Input Signal

images/download/attachments/134794994/00_native_input.jpg

Matte Before Hue Adjust

images/download/attachments/134794994/01_first_matte.jpg

Matte After Hue Adjust

images/download/attachments/134794994/02_second_matte.jpg

White Point (Transparency) and Black Point (Opacity)

images/download/thumbnails/134794994/image2021-4-27_10-43-47.png

After the hue adjustment, we should adjust the white point. This scales the input values so that the background is fully keyed (full white on the Matte view). Start from 100% and reduce it until the background is fully white, Do not reduce it more as necessary, as it would start remove details at the border of the foreground.

Now we need to find the black point, which scales and shifts the input values so that the foreground is fully opaque. Start from 0% and increase it, until your foreground is fully opaque. Have a look on details and borders and do not increase it more as necessary.

Matte Before White Point Adjustment

images/download/attachments/134794994/02_second_matte.jpg

Matte After White Point Adjustment

images/download/attachments/134794994/03_matte_with_whitepoint.jpg

Matte After Black Point Adjustment

images/download/attachments/134794994/04_matte_with_blackpoint.jpg

Processed Foreground / RGB

images/download/thumbnails/134794994/image2021-4-27_10-35-40.png

After the base adjustment of the hue and the white point and black point, you should adjust the RGB values of the processed foreground. These values are subtracted from the input signal and then are used in a linear keying mechanism, so the goal would be that these RGB values match the color of the background. Try to adapt the values so that they match the dominant color of the unprocessed input, but make sure that you do not use higher RGB values as needed. Incorrect or too high values decrease the quality of the linear keying and get noticeable with false colors around the edge between foreground and background.

Input Signal

images/download/attachments/134794994/00_native_input.jpg

Processed FG before RGB Adjustment

images/download/attachments/134794994/05_after_matte.jpg

Processed FG after RGB Adjustment (0.345, 0.713, 0.078)

images/download/attachments/134794994/06_after_rgb1.jpg

Cyan / Magenta / Yellow Gain (CMY Gain)

Due to the despilling process, which removes greenish / blueish parts of the skin, it can happen that the color tone is modified too much. Use the CMY gain adjustment to bring Cyan, Magenta or Yellow back as necessary.

Before CMY Adjustment

images/download/attachments/134794994/06_after_rgb1.jpg

After CMY Adjustment

images/download/attachments/134794994/07_after_despill_get_back.jpg

Final Result

Now add a background or your Virtual Studio and check the result:

images/download/attachments/134794994/08_final1_with_background.jpg

Other Parameters

Background Lightwrap and Color Lightwrap

Color Lightwrap

Adds a specific color either around the edge (Edge Gain) or in the spill areas (Spill Gain).

Background Lightwrap

Blends with the background, either around the edge (Edge Gain) or in the spill areas (Spill Gain)

No Lightwrapping

images/download/attachments/134794994/precision_keyer_no_wrapping.jpg

Color Lightwrap, Edge Gain = 0.5, Color = RGB(255, 0, 0)

images/download/attachments/134794994/precision_keyer_redcolor_wrapping.jpg

Color Lightwrap, Spill Gain = 0.4, Color = RGB(0, 0, 255)

images/download/attachments/134794994/precision_keyer_spill_color_0.4.jpg

Background wrapping, Edge Gain = 0.3

images/download/attachments/134794994/precision_keyer_background_wrapping.jpg

Background wrapping, Spill Gain = 1.0

images/download/attachments/134794994/precision_keyer_spill_background_wrapping.jpg