Silly-Sausage : Here's another idea...I put my SLR credentials into HereSphere and then I get access to all the AI passthrough matte streams, which the HereSphere combines with the videos. Win-win, SLR gets their subscription money for the tech they've developed, and I get to use the VR player I want.
Of course the HereSphere dev would have to build this in to his app, because it doesn't have this feature yet.
sunkenlust Sounds good, but i think both our great ideas are very unlikely
Silly-Sausage : Maybe. AI background removal seems to be everywhere right now, getting incorporated into smart phone photo software and desktop editing software. Maybe SLR is even using one of the free open source tools out there. If SLR won't let subscribers download their matte files, maybe we can start making our own because the tech will be so ubiquitous. HereSphere would still need development work to make use of them in the future.
sunkenlust If SLR won't let subscribers download their matte files, maybe we can start making our own because the tech will be so ubiquitous
Too be honest i'm too lazy to be bothered with all that stuff these days and if somebody does something well then i'm happy to pay them for it, for now
Silly-Sausage : I thought I'd run some tests using an AI powered background removal After Effects plugin. On the lowest (least accurate) setting 1 hour of 4K 60fps footage takes about 6 hours of rendering. This is on an M1 MacBook, still considered a fairly fast computer (even though 4 years old). So it takes a bloody long time to make these mattes. Now I know why it's taken some time for SLR to go through their library; they probably have a small farm of computers working on this. Not so easy to do it yourself.
sunkenlust Low-powered laptops aren't a good choice for rendering videos
sunkenlust I don' t think it's worth it for me, if i was in my 20's and excited to be involved in tech when it was genuinely exciting then maybe i would look into it, but i'm now at the age where i understand life and getting away from tech is important, so i'll let others waste their life and get paid for their time.
Mac Pro Wheels - $699.00
SLR Lifetime membership - $599.99
End of story.
SchnuppiLilac hahaha jesus fucking christ 849€ for four wheels in the EU haha had to look it up to believe it. That must be the worst deal I've seen in a long time. Makes my 4090 seem like insanely good value and that's saying something
sunkenlust Yeah it's super slow right now. But give it a year or two and you'll run through these on good hardware in no time is what I'm guessing. AI is moving fast
Hey guys can you please share your experience with Video background remover tools ? What software (workflow) do you use ? Guess there are programs that benefits of the AI compute power of todays PC GPUs ! As i know Adobe After Effects and Da Vinci Resolve Magic Mask can do the job . Is there any good dedicated tool for this ? Thank you in advance !
boboweb I've done it, a few times (different methods / models over the last 1, 2 years). You can get pretty good results depending on your proces however processing a video takes about 10+ hours on my 4090 with like a 40minute 8k scene. It's too much of a hassle for me at the moment really. I'll wait when the models get faster or when SLR drive turns out to be a good easy solution.
Btw, your best bet at the moment is to first segment the video and then generate the alpha mask based on the segmentation (you have models that refine the rough segmentation in real good alpha masks). I believe someone on the eroscripts forum posted something like this some time ago too. Don't think there is any consumer solution that does this well at the moment though. But I haven't checked in a while.
boboweb : I've been testing out "Goodbye Greenscreen", an After Effects plug in for $80. Haven't compared it to others yet, but what piqued my interest that it combined a "difference matte" using a clean background plate and AI. Most of the scenes I'm interested in trying this on do have a locked down camera where you can sometimes extract a clean background plate. I'm on an M1 MacBook, so you're might get a faster render with the best PC graphics card, but I'm not sure how much the "AI" part uses the GPU. As I said above, on the lowest quality setting 1 hour took 10, so if the best GPU cut that in half it's still a bloody long time. I've been thinking about maybe making some VR PMVs and using it sparingly, but to try and replicate what SLR is doing and doing a whole library takes a lot of time and resource. Maybe worth it to convert some of your favourite scenes.
While doing research for it I kept seeing CapCut being mentioned, but I decided to avoid it because there were many reports of it being Chinese spyware (it's made by the same company that created TikTok).
sunkenlust basically all these AI models use the GPU and if they don't they are exceptionally slow. Also a 4090 is 611% faster then an M1 (quick google search) so that's still pretty fast for a background removal program.
However, more generally I think a lot of time is wasted in re-encoding the video with the green background. It would be much faster just to generate an alpha masked that is applied on top of a video (similar to what SLR is doing) but no player supports local masks like that yet.
Honestly i believe this isn`t so complex task for present top GPUs and with good AI hardware and software optimization it must be done in real time on GPU like 4090 ... Hope we will see such software in very near future ...
fenderwq : Looking at the "Goodbye Greenscreen" product page again, and it does confirm what you're saying. It says it's hardware accelerated for on Nvidia GPU on Windows and M1/M2 and AMD on Mac.
boboweb Hello. I have personally focused on creating passthrough videos, primarily using JAV content. I have tried utilizing numerous libraries available on GitHub, as well as paid background removal services like After Effects, DaVinci Resolve's Magic Mask, and RunwayML.
After Effects performed surprisingly poorly, and the GitHub libraries were not suitable for VR videos (similar performance to CapCut). The services that I was relatively satisfied with were DaVinci Resolve and RunwayML. With an RTX 4090, DaVinci Resolve completes the process quite quickly. However, DaVinci Resolve struggles to track the person if the female performer transitions from the cowgirl position to the doggy style position.
RunwayML is convenient and tracks people more naturally than DaVinci, but it has a 4K limitation and a 15-minute time constraint. I have heard that if you convert the entire video into frames and remove the background in a photo format, u2net_human_seg can be useful, but I have not utilized it myself.
I have converted JAV 8K videos ranging from 1 minute to about 15 minutes into passthrough format. However, after SLR started mass-producing AI passthrough videos, I discontinued my work.
If you want to remove the background of videos not available on SLR, as someone with some experience, I recommend using DaVinci Resolve's Magic Mask and RunwayML.
