• Content

  • A passthrough for any video?

There's a big difference between processing an image vs building an AI that can do thousands of videos in real time, all with different LUTs, bitdepths, etc. And work on multiple different platforms.

There's very good background removal software, but you still need to edit them individually semi-manual.

The ideal way would be using a depth sensor cam like Azure Kinect or Intel RealSense to record depth maps that then can be used as alpha mask, but there are technical hurdles every step of the way. It also doesn't work retroactively.

So how can we make an AI that does this with certain accuracy. Teach it all the body parts and movement flow prediction. Remove the rest. - I'm pretty impressed with the computer vision our SLR team has put together so far!

This AI can then also be used for other things, like censoring of JAV video. I believe this is still mostly done manually now. Generating scripts...

Vrsumo2017 hopefully that sheds some light on why it's not as simple as it might seem. Instead of identifying background to remove, it needs to identify what not to remove. This is not a one-off tool we're building. This is for making it part of the workflow in SLR, actual development and production.

Future, this can then be expanded in multi axis toys, hololenses, haptic feedback other than strokers, to eventually something like sex-androids.

@doublevr has posted each of these things individually all over the place already, but he never bothers to explain it or paint the bigger picture 🙂

As SLR staff I'm of course biased, but our R&D really sets SLR apart from any other studio!

      Vrsumo2017
      Thanks for the link!
      We are looking for existing solutions too since that will be a shortcut to the greenscreening. Unfortunately the existing background removals or segmentation algorythms are trained on clothed persons, usually not making sex. So they oftenly fail on non-standard for ticktock poses and cloth


      Re-training the algorythms is possible but requires a lot of manually-segmented data into specific domain, so we are trying some creative approaches before going to that pass.
      One of them is depthmap-based selection (depth estimation from stereoimages is domain-agnostic task), but it has some drawbacks (depth treshold selection is not intuitive and some objects are closer than model). Other approach is usage of state-of-art language-image models for natural-language-driven segmentation. Potentially such approach can overcome the limitations of traditional deep-learning segmentation - recent results are promising

        Cool option for the deo pt would be to be able to have my "custom panorama" background pic be layerd behind the vr video I'm watching, I might be able to use my laying cg position background picture and that's how I could probably get color for the passthrough. The bg would be my picture.

        I made a 2d greenscreen video with my laying cg position bg picture and over layerd it with a vr video, I just used one side tho, so zooming and positioning was needed, added sum music, watched it in deo, zoomed in sum and that shit looked crazy, was it perfect? No but it close enough to get a since how it could work. Was cool to make. Literally takes like 5 minutes, plus I was just making short 3 min clips.

        But anyway, when I was watching the video in vr I thought...well maybe if I could use a "custom panorama" and have it behind the vr video as it plays and when i use the deo passthrough options my bg pic is behind it.

        Was just a thought i had how q2 users could maybe get sum bg color.. 🤷‍♂️

        A user commented about this website, it seems more advanced then that capcut but it's a website you have to sign up on to use it, it's free but I don't think I wanna be uploading adult content to their site, but I was thinking if slr had something like this inside slr website the users could make short ar clips and upload them for viewing, that would be fun.

        The program looks easy to use but looks like it works more advanced at making ar.

        It's called runwayml
        https://m.youtube.com/watch?v=5AylJMUVeEs&feature=youtu.be

        I got a question, the deo site, would I be able to use that site as a private user and upload short clips for my own personal use and for my own viewing?

        On that capcut I found out how to keep male models body, instead of choosing "remove background" you choose the chrome key and use the intensity bar.

        See 👀

        That capcut pretty cool and simple to mess with.

        Lol, yall should try the 2d video I did , i mentioned it few comments up...👆, i made a few of em already, when you watch it in vr and zoom in sum it looks like vr but with less fov, if that's what color pass through looks like, wow 👌

        Anyway, if anyone trys to do it hit me up, I give you the details if you need help, its very simple. 👍

        I threw a 8k vid in it and just cut out what i didn't want, so I just made cg rcg 3 min vids, rendered pertty smooth, but over 3 mins gets kinda slower to export.

        👍

        Is this passthrough stuff not possible on a G2? Can't seem to find how to get it to work...

        Vrsumo2017 I like how it cut the male model out

        Hummm 🤔
        So I been making sum passthrough vids and figured out how to leave the male body, idk man kinda starting to like the male models full body in, looks great with the hip thrusting movments and with solid clear penatration. Looks great 👍

          Lol, man I been adding music to my 3 min clips, I add sum trap instrumental beats on low volume tho so it's in the back ground, makes it seem old school porno-ish but in 2022 😁👍

          Got me thinking what if the slr player had options to play copyright free music and volume to adjust. As an option, I'd be into that, I'm sure there's sum directors that be producing music too, could feature their music as well.

          Anyway just a thought o had. 👍

          I might just start making my own 5min clips of my favorite positions and add music in the bg for my own use.

          Edit:
          Just thought something, maybe sum sound effects, lol I added a Lil echo to one of my clips, high as fuck very trippy lol 😆...straight dreaming

          @Vrsumo2017 ive been trying to mess with Chroma key but it sucks. I also lose the chest of the guy in removing the background

            sletje

            sletje I also lose the chest of the guy in removing the background

            I know, idk why it does that...

            But!
            Click on the "cut background" first
            Then click on "customize cut out"
            It'll show pink on the models, use the brush tool to color the male models body in with pink then it'll leave the male body in when it cuts out the background.

            Once you get it down it works good. 👍

                @Vrsumo2017 ill give it a try!

                I rendered my first video fully overnight. I did some trials yesterday and holy fucking fuck what does this look insane!!!!!
                Video is NA - Gabby Carter.

                Bro the way she is sucking your dick and teases you while sitting on a couch is fucking unreal.
                Can't wait for Deovr to release for my pico 4, THIS IS NEXT LEVEL

                5 years ago we started with a carton box with your smartphone in it and now we have envolved in having everything sharp and in color in your own living room. INSANE

                Wrote the simplistic UI for the natural language-driven matting, so there is more control over what exactly should be cutoff

                stunning !

                Can we have a little recap?

                what is the software? can we do this directly in the oculus quest 2 after having transferred the downloaded video?
                if not, do you need a powerful computer to manage this software?

                do you have a tutorial from the beginning to the modified video?

                  Shonoka got this from a user:
                  this application https://www.capcut.com/
                  is amazing for making any video into passthrough
                  its like
                  it keeps the whole person
                  in right colours
                  with normal passthrough
                  it loses for examples
                  black lingerie
                  or some clothes that the person has on
                  https://gyazo.com/247a4ee0d31282a3eaf771638912d5d5
                  it filters everything out
                  quite nice

                  Was surprised how good is it. But it has a problem - works well on 60% of scenes but completely messed on others (posted failed screenshots on forum) . Still may be usable
                  https://i.imgur.com/DEImEyJ.png

                      sletje male model in, or male model out? Sum definitely would prefer male model out, I did at first but after a few edits I think I like model in, but it's great to have an option for either or. 👍...I'd use both, lol one week I might have a faze where I like no model. But having that option is good...

                      I saw someone comment they would like to take the male body out but leave the background and female model in, im curious how that would look, ima try editing one to see.

                        doublevr with normal passthrough
                        it loses for examples
                        black lingerie

                        And tattoos, you seen how models with tattoos the tats get passthrough'd? More noticeable with full body tattoos.

                          doublevr Was surprised how good is it. But it has a problem - works well on 60% of scenes but completely messed on others (posted failed screenshots on forum) . Still may be usable

                          It's available on computer too? I been using it on my phone, it works decent enough , very simple use too 🤷‍♂️, with a note phone or phone that uses a phone pen it might be way easier to edge up cut outs with the brush tool.

                          60%? Humm 🤔, I'm normally just making laying cg rcg and pertty much everything I edited worked well with the cut outs, id say it worked 90% for me.