Suggest background composition themes for Passthrough videos

I would love to see the ability to replace the background with another video layer. I know most of your content is shot on the K2 pro, so I would like to see some people who still own this camera shoot some quick footage in wild locations such as public spaces or landmarks from the laying down perspective that we can either play or loop in the background. Imagine one of your passthrough scenes with the Eifel tower in the background or from an exotic beach somewhere, or hell in the middle of a shopping center or parking lot haha. I know that the position of the camera changes several times in each scene but if we could either shoot our own points of view with a K2 pro or if people start sharing some scenes from all the different points of view, we can easily compile the background layer to also change in each change of view. I dont own the k2 pro anymore but I have a few shots of my living room where I simply keyed the background to one of your videos on premiere pro and it looked fantastic, much better quality than any crappy Meta 2 passthrough or any other headset in the market, it was true k2 pro quality background and it was like I was doing the pornstar in the middle of my own living room with the best quality possible. I really hope this feature pans out, trust me, people dont understand how good the passthrough looks with full resolution and camera matched footage vs crappy headset passthrough, its insane and until people experience it they wont understand it.

Sandi_SLR fantastic! Cant wait to play with this.
Quick question, can you plan on adding additional details to your passthrough videos that show timestamps or marks each time the camera changes? It would be great if we could get additional info on these passthrough videos at each camera change position, doenst have to be exact but something like "Horizontal, 18" above floor" or "Standing, tilted down, 6ft off the floor" or "laying down, tilted 10 degrees up, 16" above the floor"

With basic meta data like that we can have people with the k2 pro shoot a bunch of clips or scenes with those types of parameters that we can then use to populate a bunch of different backgrounds in the correct order and so that they are facing and angled correctly for the scene. It might sound like a hassle but if you are really serious about adding this second video layer option for custom passthrough scenes so we can load our own then you should really consider adding this level of information on your passthrough scenes.

metichemsi We dont have such info, especially height. The rotation is actually possible to find out when editing, but still we wont do that. Instead I already planned to allow bg having its own set of transform settings, as a child to the main dome. So you will get all the freedom to match the angle

Sandi_SLR Ok, that sounds good, I look forward to seeing how that works out. Forget about the height then but knowing at least the general angle of the camera at each instance would be helpful enough for us when we film our own bg shots. I've experimented with this and combining a sex scene that has the camera tilted up or down slightly with a horizontal background looks bad so I'm curious to see how far the transform settings can help with this before you start running into the edges of the bg footage either at the top or bottom, depending on the angle.

Very exciting to see you guys still keep experimenting with new stuff.

Any idea of when these features might start making it out? Days, weeks, moths, sometime this year?

doublevr I imagine a flat video that we imported on the VR headset and that would be playing at the same time as the VR video

Vrsumo2017 pornception....

Vrsumo2017 Wow this is great, this exactly what i wanted... sadly I can't use deoVR.
This should be add to the SLR app for sure !

Vrsumo2017 Being myself a monotasker, I do not get it why you guys would want to watch videos inside a VR porn video. Maybe the news channel but more porn? To be more efficient? To increase the dose? I mean you are not married to the 3D girl for 25 years and she will not tell you to go F yourself like when making phone calls or checking e-mails during sex. In some next gen VR, the 3D girl will smack you and walk away furiously when you even dare to think about Android overlay

DeoVR has a custom background setting i've set with some AI generated skyboxes from blockade labs. It would be awesome if the DeoVR background settings could be used instead of room passthrough.

SchnuppiLilac I do not get it why you guys would want to watch videos inside a VR porn

No one gets it, but it’s provocative… it’s gets the us viewers going!” (Will Ferrell voice) lol

SchnuppiLilac In some next gen VR, the 3D girl will smack you and walk away furiously when you even dare to think about Android overlay

Lol

doublevr I'm actually trying to do an unreal engine crash course so I can generate my own CGI backgrounds, since I dont own the K2 pro anymore and the canon footage just doesnt line up at all, I am working on trying to work out the workflow to export my own CGI scene matching the FOV and fisheye directly from unreal. I'm a total noob at unreal engine but I'm pretty close I think, I just need to hammer out some details with the developer of a plugin I am trying to use. Once I make progress I will start to share some very basic examples, that is, if I dont pull my head off as I'm learning this damn thing.

SchnuppiLilac I’m sure there are people in real life who fuck while having porn on in the background.

petermc Yes, there are and I know a few of them personally But the other thing seems to me like going to a concert with Spotify on one ear or watching Netflix in the cinema. I am not judging, just want to understand, maybe I am missing out on something

doublevr Ok, I have been at it since last night after work. Made some progress this afternoon and managed to get my first successful export just now.

I now have a more profound respect for the few people out there making CGI VR simply from the rendering standpoint. I dont have a very hefty PC but it takes me about 15-20 minutes to render one frame and with essentially a super small and barren scene. I cant imagine how long it would take a full scene with actual significant assets and sequences. I can see why we dont have a plethora of high quality VR CGI now.

Please dont judge too harshly, I do not know unreal engine at all, I just picked this up and this was more of a proof of concept render attempt. At this rate I dont think I have the rendering power to render out actual videos. At this rate it would take my PC about 8hours to render about 30 frames. Anyways this is not perfect but keep in mind that I was able to export this image out of unreal as you see it. Also please take note that my camera in unreal needs to have it's focal length tweaked, I think by default I left it at 12mm but I think it should be 8mm. I do have it set to a 200 FOV but to view this correctly on DEOVR app I noticed you have to manually select the 220 profile, the 200 profile looks squished. Anyways, I am going to attempt a second render changing my camera to 8mm instead and see if that looks good at 200 FOV profile.

Anyways, to view this first test load it on the app and select the 220 profile, its not perfect but it works!

Let me know what you guys think. If any of you want to see this once I get the right camera lens settings let me know.
With something like this I can take this image and key it as a background on premiere, although I will still need to tweak the camera height and angle, based on the sex scene I first try out, but you guys should get the point.

Ohh and by the way, I rendered this at the 5800x2900 resolution so in theory it should match with the SLR scenes perfectly once I get the correct lens settings.

doublevr check out the "fixed" version with a quick and dirty key on premiere on a scene approximately the right height.

metichemsi fuck it looks hot as hell there

Looks good tho

Vrsumo2017 Thanks, now that I figured out the VR workflow/export part I can focus on learning the actual unreal engine portion, meaning the actual scene building and adding a little raytracing haha

Looking forward to your implementation of allowing us to inject custom backgrounds.

metichemsi in that cap cut I would take a pov picture in a laying position in my bed and use it as a background but it was 2d, it looked pretty good but I couldn't figure how to do it like you got it there double image. That be good for quest 2 to get sum color.

Vrsumo2017 yea, sorry i dont remember if it was you or another one in your team, but they shared that perhaps the first implementation of this would be to simply allow images as backgrounds since the process of playing two separate video layers might be system intensive for current standalone headsets or medium computers, so these type of image renders would work great to start off with.

I'm going to start looking through the unreal asset store and see what I can put together next for an interesting location.

metichemsi That's pretty damn good. I could see myself watching that scene and having that suspension of disbelief for that background to feel real.

sex33 Thanks, the composition and execution is really trash, I just learned how to make a super basic scene and I added some assets like those rocks and pebbles, what I wanted to test first was to see if I could render out that VR background, now that I have that worked out I can get more assets and start learning how to build better scenes or see what is available online for me to load in unreal and take some VR snapshots from different angles. I'm working on getting another laying down position but from the inside of some space station that I found for free on the unity store haha

This should make a cool looking background and set for one of these sex scenes.

sex33 Quick update, after some serious hair pulling I managed to get this working with actual scenes. Most of these are free on the marketplace so I wanted to see how a proper scene would look like and I am very impressed. The main thing to work out now is a better sense of the camera height in relation to the sex scene and the background.

I think on the first screenshot I will share below I almost nailed just about the correct height, the other two screenshots seem like I rendered the background just a little to close to the bottom surface, its an easy fix, I just have to reset those scenes with the viewpoint a little higher and re-render again.

Vrsumo2017 a couple more with proper scene elements. Here are a couple of new renders I did, the only thing I have to nail down is the correct height of the background in relation to the camera in the sex scene being used. The first screenshot looks like it got it just about right, the other 2 are too close to the background floor level, i just need to move my camera a little higher and re-render the image, but the rest looks really cool with actual proper scenes.

Let me know what you think.

metichemsi Wow, really nice renders!
Support for choosing background is in development. Hopefully soon we all can enjoy replaceable background!
Stay tuned!

I'd assume that you should follow Apple with their new clouds animation. That would be a natural addition for folks in the Apple ecosystem.

metaverse I am curious how this is going to work when positions or zoom levels change. Will the background adapt?

SchnuppiLilac Yes it will adapt since it will be the same size as the dome the video is projected on.
The biggest difference will be if you load a stereo image or non-stereo/panorama.

Sandi_SLR Thanks. So I understand that scale is not an issue. But how about positioning? In the examples above, there is a room with a bed that works well for the laying CG. But if the scene changes to a standing BJ, you would need a completely different background, like a floor viewed from above. How would this work?

SchnuppiLilac @Sandi_SLR
This is something I am also very curious how they will develop even with all the transform sliders they plan to give us, it will still require pausing the video and adjusting each time the scene changes. Hopefully they implement some sort of tag system that can "remember" all of the modifiers throughout the entire scene so you can theoretically scrub through the scene at first, setup the modifiers at each change and then restart the video and have it done all automatically for you.
Even better, it would be cool if they could incorporate meta data into their videos that would automatically make all these changes for you since they will all be the same. Meaning if all 360 backgrounds are rendered from the same point then they would know exactly how to modify them for each sex position change in all of their scenes for us. Again, that would require more work from their part, so I doubt that will happen, but it could be done.

I can also render all these backgrounds in 360 stereo but I cant test any of that functionality because it doesn't exist on their app yet but once this gets rolled out I plan on making these into 360. These current tests that I'm doing and sharing screenshots for are to manually key on a video editor and render out, I did 20 second clips for each background and they look amazing, I just have to change the camera height a little on the last two.

All very exciting stuff

Sandi_SLR nice, when can we start testing this? Also, I would like to start rendering out some of these BG in 360 stereo but I have a quick question. Because the transform sliders will be used, in your opinion, what will be the best point to originate the render from? Because renders, just like video will always have superior quality closer to the sensor, anything originally further away will always have less fidelity. Would you recommend starting the render a few feet above the ground, lower to the ground? Just thinking out loud as I'm writing this, what would give the best balance or most usable sweet spot taking into account all of the expected transformations on any given scene.

Thanks