Vrsumo2017 What scene is that from, bro.
A passthrough for any video?
you don't want to share the whole video with us?
alibaba badoinkvr scene "in a flash"
Vrsumo2017 how does passthrough work on the jav studiosοΌ
- Edited
Hi all !
It's look like the dev team working well, thanks for that !
Do you think is possible to replace the flux that the Quest 2's send you in background by another source ?
Put a cam on the headset and replace the bad quality of Quest 2 will be nice !
And if you can do this, possiblity of creating some cool things would be crazy, cause if so, you can edit the new source to cuting/tweaking things before send to the BG input
sheldoncooper I found a quite a few jav scenes that worked well, but that was with with the first passthrough version. The new updated passthrough has sum flaws, i think slr working on tweaking it.
- Edited
doublevr
It's owned by the same company that owns TikTok. Check their Privacy Policy.
In case that's something you would care about uploading this, or your, content to.
And I THINK they stole it from https://runwayml.com/ which is owned by Runway AI, Inc
They allow local use of the software with your own GPU(s)
- Edited
Rakly3 In case that's something you would care about uploading this, or your, content to.
I thought about that too, it says not to upload nudity but I think that's if u make an account and uploading to their capcut or tiktok websites. I use it with no accounts
Yall ever heard of bandlab? It's like a instagram/music making website/app all in one...
I was thinking something like would be cool, but swap out the music making with video editing/vr remixing.
Just a thought I had.
- Edited
Any quest 2 users use the 13.3 passthrough version with guardian off?
Very easy to transition into positions and move the headset "the hottie model" anywhere in ur room.
very annoying having guardian on. It best off and works great
Well, it did.
Anybody know about some good software (for windows, not online) to make passthrough video's? I tried Capcut which is nice but somewhat limited. Would be great to be able to paint your selection easily like on capcut mobile and to save it with a higher resolution than 4k.
deni12 Gonna play around with U-2-Net when I have a bit of spare time. Not a program but seems easy enough to implement (in action: https://github.com/xuebinqin/U-2-Net#usage-for-salient-object-detection). There are also quite a few wrappers already available, like this one for python: https://github.com/nadermx/backgroundremover.
- Edited
Try this model:
https://github.com/PeterL1n/RobustVideoMatting
It handles VR scenes surprisingly well (especially if lighting is "normal"):
https://www.redgifs.com/watch/coordinateddarkredbuzzard
I wrote a python program that uses gpu to decode video frames, feeds it to model and then encodes it back so it quite fast.
- Edited
i just do it with affter effects and rotoscoping here... xD
don't know before that there exist such nice tools and better ways to do this...
would be awesome to see in future a AI app for this which does it on the fly and for any video and good quality.
keep doing and research on this guys...very cool stuff !
- Edited
dudu32 would be awesome to see in future a AI app for this which does it on the fly and for any video and good quality
Version 13.3 did that on the fly...
Every video you watch you just had to start off like this
In this order
Pass-through on
Saturation on
Color range about -10 and pull it back till you got a decent enough Pass-through
And opacity to about -99 (if needed)
Worked really good
Work well with many videos, the videos that didnt work so well THEN you needed to find the background color, which I rarely did.
Was very simple. And the Pass-through you got worked through out the whole scene 95% of the time, this new version it looses Pass-through when it cuts to a new position/camera angle, not good
And 13.3 version with the guardian off for quest 2, it was very easy to move around in your room, position the model in different locations in the room or house, standing doggy or if they did a doggy on a chair I like positioning the model on my desk chair, then I might mover to the edge of my bed...
13.3 version was very simple, fast and very fun to mess with it. It was crazy good compared to this new version.
Vrsumo2017 I agree that this is harder now (only the XXLayna scene really works for me) but still even when it worked at its best it was nowhere near what is possible with a good AI. For reference, this is an image from the upcomming scenes that went through one of these models. This kind of thing simply isn't possible with chroma keying (making a color transparent).
Really curious to see what the SLR devs will come up with too. I hop it's based on a precise pre-rendered "mask". In the meantime I'll use some of the AI's to give me some content to bridge the gap
fenderwq
Is it U2-Net model? Very nice results (although I would prefer to mostly cut off the guy).
What scene and minute it's? I would like to compare it with RoboustVideoMatting model.
"This seems far more practical."
I wouldn't be so sure I can transcode 5k video at 100fps so pretty fast but it's heavily optimized code running on rtx 3090. Would be probably hard to run it on other machine (people would have to compile two c++ projects [or trust my binaries] and download bunch of tools from nvidia [cuda + cudnn + tensorRT])
- Edited
fenderwq but still even when it worked at its best it was nowhere near what is possible with a good AI
13.3 version worked well, decent enough, but I could find quiet a few scenes it worked really well, it varied and depended on the background. And I found many good Pass-throughs with very less effort.
They got this one scene coming out soon, guy wearing all black, man that's gonna look really good, I've seen scenes where I could get rid of the guy and just his stunt cock was there, sheeeesh!
Literally look like she on top of you, and when she rub his chest, slides her body "tits" on his chest or rub around his stunt cock her hands look like they rubbing on ur skin, and rcg with her legs under his... her legs look like they under yours, I got these results with 13.3 version, I'm sure this new update u could get them results but it just takes to much effort.
Male body in or out? I like having the option for both
But most definitely when ever they get it to work perfect, OMG!
Vrsumo2017 the man body is the main reason that breaks immersion