A passthrough for any video?

AlexSLRLabs

Vrsumo2017
Thanks for the link!
We are looking for existing solutions too since that will be a shortcut to the greenscreening. Unfortunately the existing background removals or segmentation algorythms are trained on clothed persons, usually not making sex. So they oftenly fail on non-standard for ticktock poses and cloth

Re-training the algorythms is possible but requires a lot of manually-segmented data into specific domain, so we are trying some creative approaches before going to that pass.
One of them is depthmap-based selection (depth estimation from stereoimages is domain-agnostic task), but it has some drawbacks (depth treshold selection is not intuitive and some objects are closer than model). Other approach is usage of state-of-art language-image models for natural-language-driven segmentation. Potentially such approach can overcome the limitations of traditional deep-learning segmentation - recent results are promising

Vrsumo2017

Cool option for the deo pt would be to be able to have my "custom panorama" background pic be layerd behind the vr video I'm watching, I might be able to use my laying cg position background picture and that's how I could probably get color for the passthrough. The bg would be my picture.

I made a 2d greenscreen video with my laying cg position bg picture and over layerd it with a vr video, I just used one side tho, so zooming and positioning was needed, added sum music, watched it in deo, zoomed in sum and that shit looked crazy, was it perfect? No but it close enough to get a since how it could work. Was cool to make. Literally takes like 5 minutes, plus I was just making short 3 min clips.

But anyway, when I was watching the video in vr I thought...well maybe if I could use a "custom panorama" and have it behind the vr video as it plays and when i use the deo passthrough options my bg pic is behind it.

Was just a thought i had how q2 users could maybe get sum bg color.. 🤷‍♂️

Vrsumo2017

A user commented about this website, it seems more advanced then that capcut but it's a website you have to sign up on to use it, it's free but I don't think I wanna be uploading adult content to their site, but I was thinking if slr had something like this inside slr website the users could make short ar clips and upload them for viewing, that would be fun.

The program looks easy to use but looks like it works more advanced at making ar.

It's called runwayml
https://m.youtube.com/watch?v=5AylJMUVeEs&feature=youtu.be

Vrsumo2017

I got a question, the deo site, would I be able to use that site as a private user and upload short clips for my own personal use and for my own viewing?

Vrsumo2017

On that capcut I found out how to keep male models body, instead of choosing "remove background" you choose the chrome key and use the intensity bar.

See 👀

That capcut pretty cool and simple to mess with.

Lol, yall should try the 2d video I did , i mentioned it few comments up...👆, i made a few of em already, when you watch it in vr and zoom in sum it looks like vr but with less fov, if that's what color pass through looks like, wow 👌

Anyway, if anyone trys to do it hit me up, I give you the details if you need help, its very simple. 👍

I threw a 8k vid in it and just cut out what i didn't want, so I just made cg rcg 3 min vids, rendered pertty smooth, but over 3 mins gets kinda slower to export.

👍

sletje

@Vrsumo2017 send me those videos, would love to test it on the pico 4 when deovr releases this week 😃

Lb01

Is this passthrough stuff not possible on a G2? Can't seem to find how to get it to work...

Vrsumo2017

Vrsumo2017 I like how it cut the male model out

Hummm 🤔
So I been making sum passthrough vids and figured out how to leave the male body, idk man kinda starting to like the male models full body in, looks great with the hip thrusting movments and with solid clear penatration. Looks great 👍

Vrsumo2017

Lol, man I been adding music to my 3 min clips, I add sum trap instrumental beats on low volume tho so it's in the back ground, makes it seem old school porno-ish but in 2022 😁👍

Got me thinking what if the slr player had options to play copyright free music and volume to adjust. As an option, I'd be into that, I'm sure there's sum directors that be producing music too, could feature their music as well.

Anyway just a thought o had. 👍

I might just start making my own 5min clips of my favorite positions and add music in the bg for my own use.

Edit:
Just thought something, maybe sum sound effects, lol I added a Lil echo to one of my clips, high as fuck very trippy lol 😆...straight dreaming

sletje

https://i.gyazo.com/76557c371e2e05278ec0d25648c3431d.gif

Vrsumo2017

sletje male model in, or male model out? Sum definitely would prefer male model out, I did at first but after a few edits I think I like model in, but it's great to have an option for either or. 👍...I'd use both, lol one week I might have a faze where I like no model. But having that option is good...

I saw someone comment they would like to take the male body out but leave the background and female model in, im curious how that would look, ima try editing one to see.

sletje

@Vrsumo2017 ive been trying to mess with Chroma key but it sucks. I also lose the chest of the guy in removing the background

Vrsumo2017

sletje I also lose the chest of the guy in removing the background

I know, idk why it does that...

But!
Click on the "cut background" first
Then click on "customize cut out"
It'll show pink on the models, use the brush tool to color the male models body in with pink then it'll leave the male body in when it cuts out the background.

Once you get it down it works good. 👍

sletje

@Vrsumo2017 ill give it a try!

I rendered my first video fully overnight. I did some trials yesterday and holy fucking fuck what does this look insane!!!!!
Video is NA - Gabby Carter.

Bro the way she is sucking your dick and teases you while sitting on a couch is fucking unreal.
Can't wait for Deovr to release for my pico 4, THIS IS NEXT LEVEL

5 years ago we started with a carton box with your smartphone in it and now we have envolved in having everything sharp and in color in your own living room. INSANE

AlexSLRLabs

Wrote the simplistic UI for the natural language-driven matting, so there is more control over what exactly should be cutoff

Shonoka

stunning !

Can we have a little recap?

what is the software? can we do this directly in the oculus quest 2 after having transferred the downloaded video?
if not, do you need a powerful computer to manage this software?

do you have a tutorial from the beginning to the modified video?

doublevr

Shonoka got this from a user:
this application https://www.capcut.com/
is amazing for making any video into passthrough
its like
it keeps the whole person
in right colours
with normal passthrough
it loses for examples
black lingerie
or some clothes that the person has on
https://gyazo.com/247a4ee0d31282a3eaf771638912d5d5
it filters everything out
quite nice

Was surprised how good is it. But it has a problem - works well on 60% of scenes but completely messed on others (posted failed screenshots on forum) . Still may be usable

Vrsumo2017

doublevr with normal passthrough
it loses for examples
black lingerie

And tattoos, you seen how models with tattoos the tats get passthrough'd? More noticeable with full body tattoos.

Vrsumo2017

doublevr Was surprised how good is it. But it has a problem - works well on 60% of scenes but completely messed on others (posted failed screenshots on forum) . Still may be usable

It's available on computer too? I been using it on my phone, it works decent enough , very simple use too 🤷‍♂️, with a note phone or phone that uses a phone pen it might be way easier to edge up cut outs with the brush tool.

60%? Humm 🤔, I'm normally just making laying cg rcg and pertty much everything I edited worked well with the cut outs, id say it worked 90% for me.

bjohnson

doublevr Just downloaded capcut, what effect or filter did you use?

Edit: Nevermind, I clicked the video, went to cutout, then auto cutout and adjust the strength, Wow that works really well.

Rakly3

doublevr
It's owned by the same company that owns TikTok. Check their Privacy Policy.
In case that's something you would care about uploading this, or your, content to.

And I THINK they stole it from https://runwayml.com/ which is owned by Runway AI, Inc
They allow local use of the software with your own GPU(s)

Vrsumo2017

bjohnson it's also good if you just wanna make your own compilation videos, man I'm adding echo, music, voice effects, video filters, you can add images like blood or tears to faces, to bad it don't have that tounge twirling effect like snapchat...

Ever wanted to be in sum kinda horror sex action? Lol you can add scary theme music, add dark filter effects for the video, put blood dripping down her mouth, deepen her voice to sound demonic, yeah u can do pretty much that, lol I did it to a Halloween scene. 🎃 lol

It's pretty cool to mess with 👍

Vrsumo2017

bjohnson Nevermind

Lol, it was simple right?

Took me like 5 minutes to learn when i got it.

« Previous Page Next Page »