Today we review some of the tools that will allow us to make and share our experiences of virtual reality in mixed reality.
Oculus Quest has a set of tools to capture images of real objects and people in the virtual environment.
Both developers and content creators have this software at their disposal that will allow them to share their virtual reality experiences. For this, the external camera captures the external images of the real world and combines them with the virtual scene, generating a single scene.
Oculus provides all the documentation for the configuration and realization of material in mixed reality with Quest.
To use it, we need the Oculus Quest and Rift viewers (or Rift S and runtime installed), a USB or HDMI camera (such as GoPro Hero 6 Black), a PC, a dedicated capture card (such as the Elgato HD60S or HD60Pro) and a green screen. Both the Quest viewer and the computer must be in the same local network.
Once the necessary software is installed, we must calibrate the camera using the mixed reality capture tools.
To finish we will start the mixed reality capture application and we will be able to compose the final scene in OBS using the Oculus Mixed Reality complement.
Another tool for mixed reality is Mixcast by Blueprint Reality. With Mixcast we can combine the real and virtual in real time, regardless of the environment.
It is compatible with a large number of applications and Steam VR games, independent of hardware and compatible with various cameras (such as Intel RealSense) that will not require a green screen.
We can use it with Oculus Rift, HTC Vive and several WMR headsets.
The necessary hardware, PCs, cameras and captors, we can consult on this page.
To use it we will have to download the free package, and drag and drop the prefabs designated in our main scene.
The Mixcast configuration process is divided into three steps:
- Configuration of your input device. We must connect the camera to the PC and run Mixcast, to configure the camera.
- Perform the configuration to align and track the camera.
- Calibrate background removal with our WildKey technology.
Once these steps are done, we will launch our virtual reality application. Now we can take automatic captures, record video or broadcast live.
The detailed tutorial can be found here.
LIV software for mixed reality is in version 1.0, and allows the capture and streaming of video. Now, with its new update, you can use avatars in your videos.
To use this new functionality of virtual avatars, you will only need the LIV application, your viewer and drivers (neither camera nor capture).
It has four modes of image capture: selfie, first and third person, and gamepad. With Steam VR external stations you can improve tracking and calibration.
Among the installation and configuration videos of this application we have the following: