Viz Artist User Guide

Version 5.1 | Published October 31, 2023 ©

Precision Keyer + Compositing on Unreal Engine 5

The Viz Precision Keyer is now available as an Unreal Integration with the Unreal Engine 5. This is a quick guide to help set up the Keyer in the Unreal Engine with the Vizrt Compositor plug-in.

Warning: Do not use Temporal Anti-Aliasing methods (Temporal AA and Temporal Super Resolution) with the Compositor and Keyer as this leads to possible artifacts on the image (similar to key and fill being out of sync). On the project settings set the Anti-Aliasing to FXAA or MSAA.

Precision Keyer Basics

Sending the Clip and Matte Scene

To send the Clip scene in Viz Engine and have it playing in Unreal:

  • Grab CLIP1 from the plug-ins.

    images/download/thumbnails/105106747/image2022-9-2_10-49-11.png
  • Add to the Media tab.

    images/download/thumbnails/105106747/image2022-9-2_10-49-36.png
  • Add a clip.

    images/download/attachments/105106747/image2022-9-2_10-49-58.png
  • Make sure you are sending the Original clip if you want to change parameters with Viz Arc

    images/download/attachments/105106747/image2022-12-15_10-15-30.png
  • In the Unreal Engine, find the CLIP1 asset. It receives the clip when in play.

    images/download/attachments/105106747/image2022-9-2_10-51-44.png


    images/download/attachments/105106747/image2022-9-2_10-55-40.png

To send the Clip scene in Viz Engine and receive it in Unreal:

  • Add a Matte Scene in Viz.

    images/download/attachments/105106747/image2022-9-2_10-54-50.png
  • In the Unreal Engine find the MATTESCENE asset, it has the matte scene when in play.

    images/download/attachments/105106747/image2022-9-2_10-53-19.png


    images/download/attachments/105106747/image2022-9-2_10-55-17.png

The process to send a LIVE input is the same as with the clip, but using LIVE1 as the asset.

Setting up the Keyer

Unlike previous versions, the Precision Keyer is rendered via a subsystem. The Media Input follows the Compositor (when available) media input so that should happen automatically when using the Compositor plug-in. This simplifies the setup when we are also using the Compositor plug-in.

The UE Precision Keyer can now be synced with Viz Engine and Viz Arc. As soon as the parameters change on Viz Arc, they are synced with Unreal Engine. Some small tweaking can be done via Viz Arc.

If for some reason we want to have Unreal overriding the parameters that come from Viz, the Keyer settings are now on a separated tab in the VizrtPawn object. To do so we need to tick Use Manual Keyer Parameters.

images/download/attachments/105106747/image2023-4-10_10-40-48.png

If we want to override the Compositor media input (or if we do not have a Compositor in the level) we need to tick Override Compositor Input.

images/download/thumbnails/105106747/image2023-4-10_10-41-29.png

Using the Compositor Plug-in

Setting up the Composite Mesh

If the plug-in is not activated by default we need to activate it.

images/download/attachments/105106747/vizrtcompositorplugin.PNG

We need to drop the Composite Mesh into the level.

images/download/attachments/105106747/image-2023-6-27_11-18-5.png

After dropping the Composite Mesh into the level we have the following:

images/download/attachments/105106747/image2022-5-12_17-22-57.png

Note: When using more than one Composite Mesh, make sure that the Render CustomDepth Pass toggle is active on both OpaqueComponent and StencilComponent for each Composite Mesh. Not having active on all the meshes could lead to color artifacts and differences between the meshes.
images/download/attachments/105106747/image2023-5-31_9-3-32.png

Setting up the Composite Planar Reflections

For the Shadows and Reflections, refer to Reflections and Shadows Compositing in UE5.

Setting up the Media Input and Keyer

Make sure you have the following activated on your Project Settings.

images/download/attachments/105106747/image2022-9-30_13-56-58.png

To change Compositor settings we need to open the Compositor Menu.

images/download/attachments/105106747/image2022-9-2_11-1-33.png

That shows the following menu.
images/download/attachments/105106747/image-2023-6-27_11-21-40.png

In the media input tab, select the input to use for the compositor.

images/download/attachments/105106747/image2023-4-10_10-42-40.png

To setup the Keyer go to the Media Keyer tab and select the Vizrt Precision Keyer

images/download/attachments/105106747/image2023-4-10_10-44-49.png

Note: If the Unreal output is being sent to Viz Engine through an AUX asset with the Overscan option set to True (used when Lens Distortion is active), the option Match Viewport Resolution with Media Input must be set to False.
images/download/attachments/105106747/matchviewport.PNG

This is the result from the Precision Keyer:

images/download/attachments/105106747/image2022-9-2_11-4-44.png

If we have a matte scene the result reflects that.

images/download/attachments/105106747/image2022-9-2_11-4-19.png

images/download/attachments/105106747/image2022-9-2_11-4-5.png

This also shows on the Viz Engine side if the AutoCapture is properly set up.
images/download/attachments/105106747/image2022-9-2_11-6-51.png

Setting up the AutoCapture to Share the Result with Viz Engine

Drag the VizrtAutoCapture into the level.

images/download/attachments/105106747/image-2023-6-27_11-19-13.png

Make sure it has AUX1.

images/download/thumbnails/105106747/image-2023-6-27_11-19-28.png

When playing the level (PIE or Game Mode), the output is shared with Viz Engine.

Warning: If transparent objects are composited using the Vizrt Compositor, please make sure the Anti-Aliasing Method in Project Settings > Engine - Rendering > Default Settings is NOT set to Temporal Super-Resolution (TSR).
images/download/attachments/105106747/antialiasing.PNG

See Also