FEEDBACK REQUESTED: Composite/CGI backgrounds for Passthrough scenes

Library - if animation possible, people walking behind the book shelf (visible in the gaps)

Sauna room

Cinema

Basketball court

Japanese night-time alley rain

Public shower room

Public changing room

One day will it be possible to record real-life backgrounds with VR camera and add to pass-through videos?

E.g. actors walking through the scene background/windows, trees blowing in the wind, etc.

This is a great alternative to outdoor scenes that tend to flood light and make the scene blurry. Would also love this is like dungeon, dark, club kind of scenes.

In my opinion the magic of the CG background is giving the crew the best lighting for the most crisp picture you can get in VR and slap it with any background/set that serves the storyline

doublevr

On the altar of an aztek temple
In a glass cage suspended over a city
In a tent in the pouring rain
In a TV studio
In a ferris wheel basket at a carnival
On the deck of a sailboat
In a viking feast hall
On a city beach at night
In the post office sorting room
In the ruins of pripyat (chernobyl)

thanks for ideas. We have some of them on the list already but write down the rest to realize future scenes basen on this.

I attach photos from new upcoming scene.

Happy New Year

g90ak does the most amazing upscales with TopazAI. Have you considered upscaling old but popular HD scenes to 6K or 8K?

Loving the CGI backgrounds -
I do wish you could release them at the same time as their passthrough equivalent.

You have a similar problem to what I see in VREdging - the first video comes out (in your case with the grey background) but I just feel I am waiting a few more weeks for the CGI version and I dont know whether I should dive in and watch right away or wait for something which (for me) is better

Schrock85 sounds great. Passed to our production team.

Do you have skills working with these?

Schrock85 Cool. Already pushing it forward ️
Let me know if'd like to give it a try
We will get you all set whenever ready

doublevr Okay. I have what i need now. Please send me a PM and we speak about the details.

I'd like to be able to watch passthrough videos with a background of my choosing. Like offer a selection of backgrounds that we can swap between, which the PT scene is composited over in real time. That would make way more sense to me than the RenderPleasure scenes where the background is hard-coded.

Is this something SLR is looking into?

bartosz The background is not the problem. The main problem is the workingtime for a good look and feel. Another good Idea is the reuse of other scenes. What does it mean? For examble: You have to shot a passthrough scene in the same camera position and the same setting (light-sources etc) like an original. The next step is the cleanup for the original picture (removing the actors) and than you can replace the original actor throug a passthroug actor. Same scene but two different models. The cleanup work is also possible in a photoshop ai for a static Framehold:

I turned on the newest cgi scene with Sisi to see what they look like.
When you are in the tint, it looks like a giant tint. About 12 feet long. Then you get outside and it's a popup tint on top of your suv. Now it looks like it is half the size.
Also it's really obvious that the water is never moving.
The biggest thing that could be added is that it is so quiet. You are outside and I don't hear what I feel like I should hear. Birds maybe