Trying to capture what someone is experiencing when they’re head-first in a VR game has been an interesting problem to crack. By matching up live video and a digital environment with the help of a green screen setup though, you can essentially create a video that places you straight in the action—one that better communicates the immersion of a VR game than a simple first-person screen capture. Oculus recently revealed in a blog post that in the past months they’ve been working on bringing native mixed reality capture support to Oculus Rift, and it’s available today for developers to start creating mixed reality videos.
Oculus has recently published a guide to teach developers how to capture mixed reality with two important tools (besides a VR headset): a green screen and an external camera. The company says developers can create mixed reality content with either a stationary camera or a mobile camera that can be attached to a virtual, in-game object—letting you capture the scene from various vantage points and making the action even more immersive for non-VR viewers.
[gfycat data_id=”IckyQuaintGermanshorthairedpointer”]
To help create a fixed or mobile camera that lets you capture you while in the physical world, Oculus has also provided a 3D-printable CAD model so webcams and small DSLRs can be attached to an extra Oculus Touch controller and either mounted on a tripod or supported by hand.
It’s not to say everyone with a VR-ready computer can create these sorts of videos though, as the requirements for mixed reality capture are likely higher than the ‘minimum spec’ published by Oculus that allowed computers as affordable as $500 to run VR games. To help out with the additional bandwidth requirements of mixed reality capture, Oculus suggests a number of components including its Oculus-approved Falcon Northwest Tiki computer (MSRP $2,899). The company hasn’t released any hard and fast requirements for mixed reality capture, but has mentioned its selected motherboards “work well” when paired with 16 GB RAM, an SSD and a GTX 1080.
As for cameras, Oculus provided support for “any USB camera,” but says that higher-spec cameras, including HDMI cameras, will predictably result in higher-quality mixed reality capture scenes.
Mixed reality setups are notoriously fiddly to build, and the company says their native mixed reality integration “does require numerous steps and a certain level of technical proficiency,” and that users should follow documentation “as precisely as possible, and pay special attention to the directions regarding Oculus sensor setup, USB ports, and chipsets.” Among Oculus’ setup guide, other guides for integrating mixed reality capture support Unity and Unreal apps are also available (Unity, Unreal, Native).
As pioneers of mixed reality capture, developers of breakout success Fantastic Contraption (2016) Northway Games published an extensive guide on how to set up mixed reality capture for HTC Vive headsets last year. Valve later incorporated the same green screen setup in their official announcement of the HTC Vive.