Suggest background composition themes for Passthrough videos

doublevr Absolutely, I'm very excited to get this working, right now it's nothing fancy at all since I'm learning Unreal from the ground up, this is more about the proof of concept of getting VR footage with the correct format you guys use for your original scenes that I can simply drop in. Once I can get this working I will also look into the same concept but with actual equirectangular format as well.

doublevr Ok, I have been at it since last night after work. Made some progress this afternoon and managed to get my first successful export just now.

I now have a more profound respect for the few people out there making CGI VR simply from the rendering standpoint. I dont have a very hefty PC but it takes me about 15-20 minutes to render one frame and with essentially a super small and barren scene. I cant imagine how long it would take a full scene with actual significant assets and sequences. I can see why we dont have a plethora of high quality VR CGI now.

Please dont judge too harshly, I do not know unreal engine at all, I just picked this up and this was more of a proof of concept render attempt. At this rate I dont think I have the rendering power to render out actual videos. At this rate it would take my PC about 8hours to render about 30 frames. Anyways this is not perfect but keep in mind that I was able to export this image out of unreal as you see it. Also please take note that my camera in unreal needs to have it's focal length tweaked, I think by default I left it at 12mm but I think it should be 8mm. I do have it set to a 200 FOV but to view this correctly on DEOVR app I noticed you have to manually select the 220 profile, the 200 profile looks squished. Anyways, I am going to attempt a second render changing my camera to 8mm instead and see if that looks good at 200 FOV profile.

Anyways, to view this first test load it on the app and select the 220 profile, its not perfect but it works!

Let me know what you guys think. If any of you want to see this once I get the right camera lens settings let me know.
With something like this I can take this image and key it as a background on premiere, although I will still need to tweak the camera height and angle, based on the sex scene I first try out, but you guys should get the point.

Ohh and by the way, I rendered this at the 5800x2900 resolution so in theory it should match with the SLR scenes perfectly once I get the correct lens settings.

doublevr check out the "fixed" version with a quick and dirty key on premiere on a scene approximately the right height.

metichemsi fuck it looks hot as hell there

Looks good tho

Vrsumo2017 Thanks, now that I figured out the VR workflow/export part I can focus on learning the actual unreal engine portion, meaning the actual scene building and adding a little raytracing haha

Looking forward to your implementation of allowing us to inject custom backgrounds.

metichemsi in that cap cut I would take a pov picture in a laying position in my bed and use it as a background but it was 2d, it looked pretty good but I couldn't figure how to do it like you got it there double image. That be good for quest 2 to get sum color.

Vrsumo2017 yea, sorry i dont remember if it was you or another one in your team, but they shared that perhaps the first implementation of this would be to simply allow images as backgrounds since the process of playing two separate video layers might be system intensive for current standalone headsets or medium computers, so these type of image renders would work great to start off with.

I'm going to start looking through the unreal asset store and see what I can put together next for an interesting location.

metichemsi That's pretty damn good. I could see myself watching that scene and having that suspension of disbelief for that background to feel real.

sex33 Thanks, the composition and execution is really trash, I just learned how to make a super basic scene and I added some assets like those rocks and pebbles, what I wanted to test first was to see if I could render out that VR background, now that I have that worked out I can get more assets and start learning how to build better scenes or see what is available online for me to load in unreal and take some VR snapshots from different angles. I'm working on getting another laying down position but from the inside of some space station that I found for free on the unity store haha

This should make a cool looking background and set for one of these sex scenes.

sex33 Quick update, after some serious hair pulling I managed to get this working with actual scenes. Most of these are free on the marketplace so I wanted to see how a proper scene would look like and I am very impressed. The main thing to work out now is a better sense of the camera height in relation to the sex scene and the background.

I think on the first screenshot I will share below I almost nailed just about the correct height, the other two screenshots seem like I rendered the background just a little to close to the bottom surface, its an easy fix, I just have to reset those scenes with the viewpoint a little higher and re-render again.

metichemsi Wow, really nice renders!
Support for choosing background is in development. Hopefully soon we all can enjoy replaceable background!
Stay tuned!

I'd assume that you should follow Apple with their new clouds animation. That would be a natural addition for folks in the Apple ecosystem.

metaverse I am curious how this is going to work when positions or zoom levels change. Will the background adapt?

SchnuppiLilac Yes it will adapt since it will be the same size as the dome the video is projected on.
The biggest difference will be if you load a stereo image or non-stereo/panorama.

Sandi_SLR Thanks. So I understand that scale is not an issue. But how about positioning? In the examples above, there is a room with a bed that works well for the laying CG. But if the scene changes to a standing BJ, you would need a completely different background, like a floor viewed from above. How would this work?

SchnuppiLilac @Sandi_SLR
This is something I am also very curious how they will develop even with all the transform sliders they plan to give us, it will still require pausing the video and adjusting each time the scene changes. Hopefully they implement some sort of tag system that can "remember" all of the modifiers throughout the entire scene so you can theoretically scrub through the scene at first, setup the modifiers at each change and then restart the video and have it done all automatically for you.
Even better, it would be cool if they could incorporate meta data into their videos that would automatically make all these changes for you since they will all be the same. Meaning if all 360 backgrounds are rendered from the same point then they would know exactly how to modify them for each sex position change in all of their scenes for us. Again, that would require more work from their part, so I doubt that will happen, but it could be done.

I can also render all these backgrounds in 360 stereo but I cant test any of that functionality because it doesn't exist on their app yet but once this gets rolled out I plan on making these into 360. These current tests that I'm doing and sharing screenshots for are to manually key on a video editor and render out, I did 20 second clips for each background and they look amazing, I just have to change the camera height a little on the last two.

All very exciting stuff

Sandi_SLR nice, when can we start testing this? Also, I would like to start rendering out some of these BG in 360 stereo but I have a quick question. Because the transform sliders will be used, in your opinion, what will be the best point to originate the render from? Because renders, just like video will always have superior quality closer to the sensor, anything originally further away will always have less fidelity. Would you recommend starting the render a few feet above the ground, lower to the ground? Just thinking out loud as I'm writing this, what would give the best balance or most usable sweet spot taking into account all of the expected transformations on any given scene.

Thanks