How AR Compositing Works

The AR pipeline

StypeLand produces the final image using a frame-accurate pipeline:

1. Camera captures real scene

2. Tracking system sends camera position

3. Unreal renders graphics from that position

4. StypeLand merges video and graphics

5. Output goes to SDI/IP

Why tracking is required

Without tracking, graphics would stay fixed to the screen.
Tracking allows graphics to stay fixed to the world.

Example:
A virtual screen placed on the studio floor stays in place while the camera moves.

What must be synchronized

For correct AR alignment the following systems must run in sync:

• camera

• tracking system

• render engine

(usually genlocked in broadcast environments)