Suggest background composition themes for Passthrough videos

Vrsumo2017 yea, sorry i dont remember if it was you or another one in your team, but they shared that perhaps the first implementation of this would be to simply allow images as backgrounds since the process of playing two separate video layers might be system intensive for current standalone headsets or medium computers, so these type of image renders would work great to start off with.

I'm going to start looking through the unreal asset store and see what I can put together next for an interesting location.

metichemsi That's pretty damn good. I could see myself watching that scene and having that suspension of disbelief for that background to feel real.

sex33 Thanks, the composition and execution is really trash, I just learned how to make a super basic scene and I added some assets like those rocks and pebbles, what I wanted to test first was to see if I could render out that VR background, now that I have that worked out I can get more assets and start learning how to build better scenes or see what is available online for me to load in unreal and take some VR snapshots from different angles. I'm working on getting another laying down position but from the inside of some space station that I found for free on the unity store haha

This should make a cool looking background and set for one of these sex scenes.

sex33 Quick update, after some serious hair pulling I managed to get this working with actual scenes. Most of these are free on the marketplace so I wanted to see how a proper scene would look like and I am very impressed. The main thing to work out now is a better sense of the camera height in relation to the sex scene and the background.

I think on the first screenshot I will share below I almost nailed just about the correct height, the other two screenshots seem like I rendered the background just a little to close to the bottom surface, its an easy fix, I just have to reset those scenes with the viewpoint a little higher and re-render again.

Vrsumo2017 a couple more with proper scene elements. Here are a couple of new renders I did, the only thing I have to nail down is the correct height of the background in relation to the camera in the sex scene being used. The first screenshot looks like it got it just about right, the other 2 are too close to the background floor level, i just need to move my camera a little higher and re-render the image, but the rest looks really cool with actual proper scenes.

Let me know what you think.

metichemsi Wow, really nice renders!
Support for choosing background is in development. Hopefully soon we all can enjoy replaceable background!
Stay tuned!

I'd assume that you should follow Apple with their new clouds animation. That would be a natural addition for folks in the Apple ecosystem.

metaverse I am curious how this is going to work when positions or zoom levels change. Will the background adapt?

SchnuppiLilac Yes it will adapt since it will be the same size as the dome the video is projected on.
The biggest difference will be if you load a stereo image or non-stereo/panorama.

SchnuppiLilac @Sandi_SLR
This is something I am also very curious how they will develop even with all the transform sliders they plan to give us, it will still require pausing the video and adjusting each time the scene changes. Hopefully they implement some sort of tag system that can "remember" all of the modifiers throughout the entire scene so you can theoretically scrub through the scene at first, setup the modifiers at each change and then restart the video and have it done all automatically for you.
Even better, it would be cool if they could incorporate meta data into their videos that would automatically make all these changes for you since they will all be the same. Meaning if all 360 backgrounds are rendered from the same point then they would know exactly how to modify them for each sex position change in all of their scenes for us. Again, that would require more work from their part, so I doubt that will happen, but it could be done.

I can also render all these backgrounds in 360 stereo but I cant test any of that functionality because it doesn't exist on their app yet but once this gets rolled out I plan on making these into 360. These current tests that I'm doing and sharing screenshots for are to manually key on a video editor and render out, I did 20 second clips for each background and they look amazing, I just have to change the camera height a little on the last two.

All very exciting stuff

Sandi_SLR nice, when can we start testing this? Also, I would like to start rendering out some of these BG in 360 stereo but I have a quick question. Because the transform sliders will be used, in your opinion, what will be the best point to originate the render from? Because renders, just like video will always have superior quality closer to the sensor, anything originally further away will always have less fidelity. Would you recommend starting the render a few feet above the ground, lower to the ground? Just thinking out loud as I'm writing this, what would give the best balance or most usable sweet spot taking into account all of the expected transformations on any given scene.

Thanks

metichemsi Yes we are planning exactly this, you will be able to have unique settings per timetag (missionary, doggy, anal...). This should cover most of it, since usually 1 timetag means 1 camera position/angle.

We will also add an option to export this settings, so you or any user can prepare it and share with others to enjoy.

Here is a quick preview of how the custom scene option will look:

If you have any questions or ideas, let me know.

metichemsi When the feature is released, just render 5 examples at different heights and test how they work

metaverse Thanks! It's been a nightmare trying to learn how to do this the past couple of days but the results seem very promising. Also, since @Sandi_SLR clarified that the actual backgrounds for this implementation will need to be 360, hopefully that wont be mono, but full stereo support, I plan on rendering these in 360 as well.

Also, by the sound of that, people who have any type of 180 or 360 camera should be very excited by this. I know I plan on using my 180 and 360 cameras to also get some 360 shots of my bedroom and home locations soon that I will be able to drop in on these as well which will give us even better "passthrough" quality than any of the headsets out or that will be out in the next year or two and all without needing to upgrade your current headset.

metichemsi You will be able to use any projection and setting the videos use (_SBS, _Fisheye...), I just mentioned 360 since if you have 180 dome and you have to change the pitch by a lot, you might see the edge of the dome.

Sandi_SLR this is great, thanks for sharing that, sounds like you guys have most of the bases covered then.

One quick question, I dont think it will matter, but will this work on both fisheye and equirectangular passthrough videos the same way? I'm thinking it wont matter but just wanted to make sure since all your content is still in fisheye.

Thanks!

Sandi_SLR makes sense, yea I didnt bother rendering these out in 360 because I cant even test that anyways. But that sounds good that you will accept any form.

Question: If you will accept any form, in my example I actually used a 200 dome just like the k2 pro footage. Will you allow multiple images to be programed into one scene as well? This would allow me to render out different angles and positions from different locations in the scene which could be very interesting instead of only recycling one 360 image during the entire scene with different modifiers for height and pitch adjustments.