The stereo-360 videos aren't really stereo
I'm working on an Unreal Engine project for VR that relies on some 360 stereo footage previously captured with Open Brush. However, to my dismay, I discovered that the videos produced by Open Brush have identical top/bottom frames! This can be easily verified in Photoshop by overlaying the halves of any frame. It doesn't provide a 3D view but rather just a 360 photosphere. The result in Unreal Engine is extremely disappointing. Upon closer examination of the generation process, I noticed that in the .usda file used by the batch process, there is this information: uniform token stereoRole = "mono" . I ran the batch for two modified .usda files (with parameters "left" and then "right" instead of "mono"), but once again, the frames came out identical (see the result in stereo-left-right.png).
However, in the next test, I numerically modified the camera coordinates to shift it 64mm to the right, and I obtained identical top/bottom frames between them but noticeably different from the previous file. I manually combined the frames (taking the top from the initial file and the bottom from the one with the right-shifted camera), and I obtained a view that, at least when looking forward, is what I need (see the result in stereo-manual.png). Unfortunately, this cannot be a solution because when looking backward, the eyes receive views that are simply inverted, as if you were looking cross-eyed. Multiple captures should be taken, gradually rotating the left-right cameras around a fixed point and combining the central strips of the resulting images. At least this is the solution described by the creators of the stereo-panoramic plugin for Unreal, where the results are indeed 3D.
https://www.unrealengine.com/en-US/tech-blog/capturing-stereoscopic-360-screenshots-videos-movies-unreal-engine-4
However, in the next test, I numerically modified the camera coordinates to shift it 64mm to the right, and I obtained identical top/bottom frames between them but noticeably different from the previous file. I manually combined the frames (taking the top from the initial file and the bottom from the one with the right-shifted camera), and I obtained a view that, at least when looking forward, is what I need (see the result in stereo-manual.png). Unfortunately, this cannot be a solution because when looking backward, the eyes receive views that are simply inverted, as if you were looking cross-eyed. Multiple captures should be taken, gradually rotating the left-right cameras around a fixed point and combining the central strips of the resulting images. At least this is the solution described by the creators of the stereo-panoramic plugin for Unreal, where the results are indeed 3D.
https://www.unrealengine.com/en-US/tech-blog/capturing-stereoscopic-360-screenshots-videos-movies-unreal-engine-4
clean_21.usda1.47KB
Unreal Engine
Here I'll walk you through Ninja Theory's particular settings and workflow for capturing 360 stereoscopic movies like the one we just launched today for Hellblade: Senua's Sacrifice. Read on to learn more about using the "Stereo Panoramic Movie Capture" feature which works out of the box in UE4.
