• SLR
  • Suggest background composition themes for Passthrough videos

petermc Yes, there are and I know a few of them personally 🙂 But the other thing seems to me like going to a concert with Spotify on one ear or watching Netflix in the cinema. I am not judging, just want to understand, maybe I am missing out on something

doublevr Absolutely, I'm very excited to get this working, right now it's nothing fancy at all since I'm learning Unreal from the ground up, this is more about the proof of concept of getting VR footage with the correct format you guys use for your original scenes that I can simply drop in. Once I can get this working I will also look into the same concept but with actual equirectangular format as well.

doublevr Ok, I have been at it since last night after work. Made some progress this afternoon and managed to get my first successful export just now.

I now have a more profound respect for the few people out there making CGI VR simply from the rendering standpoint. I dont have a very hefty PC but it takes me about 15-20 minutes to render one frame and with essentially a super small and barren scene. I cant imagine how long it would take a full scene with actual significant assets and sequences. I can see why we dont have a plethora of high quality VR CGI now.

Please dont judge too harshly, I do not know unreal engine at all, I just picked this up and this was more of a proof of concept render attempt. At this rate I dont think I have the rendering power to render out actual videos. At this rate it would take my PC about 8hours to render about 30 frames. Anyways this is not perfect but keep in mind that I was able to export this image out of unreal as you see it. Also please take note that my camera in unreal needs to have it's focal length tweaked, I think by default I left it at 12mm but I think it should be 8mm. I do have it set to a 200 FOV but to view this correctly on DEOVR app I noticed you have to manually select the 220 profile, the 200 profile looks squished. Anyways, I am going to attempt a second render changing my camera to 8mm instead and see if that looks good at 200 FOV profile.

Anyways, to view this first test load it on the app and select the 220 profile, its not perfect but it works!

Let me know what you guys think. If any of you want to see this once I get the right camera lens settings let me know.
With something like this I can take this image and key it as a background on premiere, although I will still need to tweak the camera height and angle, based on the sex scene I first try out, but you guys should get the point.

Ohh and by the way, I rendered this at the 5800x2900 resolution so in theory it should match with the SLR scenes perfectly once I get the correct lens settings.

Vrsumo2017 Thanks, now that I figured out the VR workflow/export part I can focus on learning the actual unreal engine portion, meaning the actual scene building and adding a little raytracing haha

Looking forward to your implementation of allowing us to inject custom backgrounds.

metichemsi in that cap cut I would take a pov picture in a laying position in my bed and use it as a background but it was 2d, it looked pretty good but I couldn't figure how to do it like you got it there double image. That be good for quest 2 to get sum color.

    Vrsumo2017 yea, sorry i dont remember if it was you or another one in your team, but they shared that perhaps the first implementation of this would be to simply allow images as backgrounds since the process of playing two separate video layers might be system intensive for current standalone headsets or medium computers, so these type of image renders would work great to start off with.

    I'm going to start looking through the unreal asset store and see what I can put together next for an interesting location.

    metichemsi That's pretty damn good. I could see myself watching that scene and having that suspension of disbelief for that background to feel real.

      sex33 Thanks, the composition and execution is really trash, I just learned how to make a super basic scene and I added some assets like those rocks and pebbles, what I wanted to test first was to see if I could render out that VR background, now that I have that worked out I can get more assets and start learning how to build better scenes or see what is available online for me to load in unreal and take some VR snapshots from different angles. I'm working on getting another laying down position but from the inside of some space station that I found for free on the unity store haha

      This should make a cool looking background and set for one of these sex scenes.

      sex33 Quick update, after some serious hair pulling I managed to get this working with actual scenes. Most of these are free on the marketplace so I wanted to see how a proper scene would look like and I am very impressed. The main thing to work out now is a better sense of the camera height in relation to the sex scene and the background.

      I think on the first screenshot I will share below I almost nailed just about the correct height, the other two screenshots seem like I rendered the background just a little to close to the bottom surface, its an easy fix, I just have to reset those scenes with the viewpoint a little higher and re-render again.



      Vrsumo2017 a couple more with proper scene elements. Here are a couple of new renders I did, the only thing I have to nail down is the correct height of the background in relation to the camera in the sex scene being used. The first screenshot looks like it got it just about right, the other 2 are too close to the background floor level, i just need to move my camera a little higher and re-render the image, but the rest looks really cool with actual proper scenes.

      Let me know what you think.



        doublevr changed the title to Suggest background composition themes for Passthrough videos .
        • [deleted]

        I'd assume that you should follow Apple with their new clouds animation. That would be a natural addition for folks in the Apple ecosystem.

        SchnuppiLilac Yes it will adapt since it will be the same size as the dome the video is projected on.
        The biggest difference will be if you load a stereo image or non-stereo/panorama.

          Sandi_SLR Thanks. So I understand that scale is not an issue. But how about positioning? In the examples above, there is a room with a bed that works well for the laying CG. But if the scene changes to a standing BJ, you would need a completely different background, like a floor viewed from above. How would this work?

            SchnuppiLilac You will get all the transform sliders, just like you have them for the video dome.
            So its up to you to rotate it to fit.

            To be clear, you would need a 360 stereo BG to rotate it freely and not see the edge.