• SLR

  • Suggest background composition themes for Passthrough videos

5 days later

MickyCheese Would it be possible to bring Alpha channel to the older pass through videos (e.g. alpha channel on Katrina Reed's video that was demoed a few weeks ago)?

Regarding scene composition, I think rendering the whole movie will be a bit better from a performance and experience standpoint.

Chromakeying and replacing the background in real-time may degrade performance significantly on quest 2 (chroma keying itself judders from time to time).

Pt fans, you need to come to the your pt headquarters

https://forum.sexlikereal.com/d/3479-your-pass-through-headquarters/837

So we can discuss pt, pt settings and find great videos that work like alpha production

    MickyCheese we are optimistically looking into advanced PT playback along with dynamic background. We don't need to transcode every video to add pass through. Just upload alpha as separate file. Should put it out to the test soon

    AI team is working to make all videos PT. Alpha channel is now default for pt.

        doublevr That's awesome! Adding a separate alpha file will save a lot of time (not sure how it will work for video downloads though). The quest 2 got a 20% performance boost via an update last month so everything should work smoothly with alpha and dynamic backgrounds.

        Just out of curiosity, how does the separate alpha channel file work with the older, chroma-keyed PT scenes (e.g. Katrina reed's PT scene)?

        I see 2 possible solutions for this:

        1. Re-Releasing the scene as a non-chroma keyed video with alpha (i.e. original green screen video without chroma key, but with alpha).
        2. Re-Releasing the color-corrected, grey version of the original green screen video with alpha (without chroma-keying).

        I believe option 1 saves the most time for editors, but option 2 is more consistent with recent scenes and is more convenient for people who don't use PT.

        @Sandi_SLR posted an alpha test a while back for Katrina Reed's PT scene, which shows what option 2 might look like.
        katrina reeed

          16 days later

          • [deleted]

          • Post #95

          I loved the ideas mentioned above, like the one about having a second video or using 180/360 degrees photos as a background then rerender it. But let's face it, pulling that off smoothly, gonna require a lot of maneuvering.

          You know those environments in "Meta Quest 2" and in similar apps like "BigScreen"? They're incredible! We can already move around, sit, and interact with everything. It feels so real! How cool would it be if DeoVR could work with that kind of environment? Like, if it could remove that virtual body and blend seamlessly into the surroundings? Seriously, that's what I'm really hoping for with this whole passthrough background thing! I might even end up watching scenes over and over.

          Well crap, now that you are back on the canon system I plan on actually shooting real life locations as well. I just dont think my footage will line up very well since it's not modded but I am super excited about using real world locations more than anything for these backgrounds. They will look 10X better than any CGI and i think there is more of a kink factor in real world locations vs made up ones.

            doublevr Damn that sounds super tempting, maybe once you guys release the info on the mod I can jump the gun on that mod on my lens. Since I shoot VR for my own personal consumption and as a hobby I cant afford to buy another lens if something goes wrong afterwards.

            Does the canon utility software still convert the footage to equirectangular correctly after the lens has been modded?

                doublevr Got it, makes sense, that's another reason I am hesitant to get it modded, I dont think I can justify a sub for mistika when I am not doing this as a business. Everything I shoot is only for my own personal viewing. This is just a hobby for me, if I ever pivot to doing paid work in this field I will definitely jump on board or if I pick up a second lens at a good deal. For now, since your app will only support image background layers when it releases, I have ways to shoot photographs with the correct IPD settings anyways using a rail system and shifting the camera 4mm to either side after taking one image and then using one eye from each set of photographs.

                  a month later

                  I accidentally took the red 💊

                  Was this a one-time thing? Or will there be more?

                    SchnuppiLilac a few more will be coming soon. we are building up infrastructure to have more of these

                      there are a couple that come to mind if i understood the whole thing right. And only one that i can see being really goodish. In a Cinema (insanity would to if you cinema screen would play videos) like thing too i guess hard kinda stuff is Panorama stuff thats hard to pull of in the scale of feeling goodish and not disturbing darker colors would probly help. Reds and Blues might burn your eyes out when they are in a panorama thing

                      a month later
                      6 months later
                      6 months later

                      advtim23 we just need them to streamline the way they film PT scenes and actually keep a record of each camera position and relative angle to the horizon for all of their scenes moving forward so people like us who also own the same camera system can easily replicate each PT shot in the real world so we can make custom live action shots at different locations for everyone to try. It's not that hard but I doubt they will go the extra mile for this

                        I didn't have time to generate any backgrounds yet myself, but I'll just leave this here.

                        Would be great if SLR could just copy this workflow and make a text input 360 background generator so I don't have to generate fixed backgrounds for videos. 😇