• Apps

  • How to watch AI Passthrough vids with HereSphere or locally?

Ok, I get it, what you say might very well be true. I thought this AI mask works the same way as alpha-packed MP4 files. But then again, when the AI model gets smarter, that would mean the videos should be reuploaded. And that would be, well, very inconvenient to say the least, considering the sheer amount of SLR content. And believing the headset itself did this heavy lifting with AI filtering was a little bit of naive thinking for me. So, it's probably that separate AI mask stream/file that I'm missing in my downloads folder. It makes sense. Now, let's find a way how to download the "offline" AI mask 🙂

BursVR To clarify, I mean downloading the mask. I'm not sure if DeoVR allows local PT even if you have the mask files though.

    BursVR : The AI passthrough mask is contained in a separate video file, and SLR appears to have put security in place to prevent subscribers from downloading that file. Maybe there is a technical reason the headset can't combine a local file with a streamed file in the DeoVR app...perhaps harder to get them to sync. But I would think it should be possible while maintaining the security. If both files were local, my guess is combining them would be easier than syncing the 2 streams. If you jump around the cuepoints in a AI passthrough video, you can see the streams go out of sync for a moment.

        sunkenlust They should release the AI Passthrough tech to other studios on licence or even to users so they can create their own masks of previously downloaded files.

        I have so many scenes that would benefit from a passthrough mask and i know a 'Drive' is coming, but that will have too many restrictions due to the size of uploads and ongoing costs involved, server space and the usual price increases with this sort of thing.

            SchnuppiLilac The chances are that it is against the ToS, but that has never stopped people from consuming content how they want to. Take YouTube Vanced, for example.

              Silly-Sausage : Here's another idea...I put my SLR credentials into HereSphere and then I get access to all the AI passthrough matte streams, which the HereSphere combines with the videos. Win-win, SLR gets their subscription money for the tech they've developed, and I get to use the VR player I want.

              Of course the HereSphere dev would have to build this in to his app, because it doesn't have this feature yet.

                  Silly-Sausage : Maybe. AI background removal seems to be everywhere right now, getting incorporated into smart phone photo software and desktop editing software. Maybe SLR is even using one of the free open source tools out there. If SLR won't let subscribers download their matte files, maybe we can start making our own because the tech will be so ubiquitous. HereSphere would still need development work to make use of them in the future.

                      sunkenlust If SLR won't let subscribers download their matte files, maybe we can start making our own because the tech will be so ubiquitous

                      Too be honest i'm too lazy to be bothered with all that stuff these days and if somebody does something well then i'm happy to pay them for it, for now

                          Silly-Sausage : I thought I'd run some tests using an AI powered background removal After Effects plugin. On the lowest (least accurate) setting 1 hour of 4K 60fps footage takes about 6 hours of rendering. This is on an M1 MacBook, still considered a fairly fast computer (even though 4 years old). So it takes a bloody long time to make these mattes. Now I know why it's taken some time for SLR to go through their library; they probably have a small farm of computers working on this. Not so easy to do it yourself.

                              sunkenlust I don' t think it's worth it for me, if i was in my 20's and excited to be involved in tech when it was genuinely exciting then maybe i would look into it, but i'm now at the age where i understand life and getting away from tech is important, so i'll let others waste their life and get paid for their time.

                                SchnuppiLilac hahaha jesus fucking christ 849€ for four wheels in the EU haha had to look it up to believe it. That must be the worst deal I've seen in a long time. Makes my 4090 seem like insanely good value and that's saying something

                                  sunkenlust Yeah it's super slow right now. But give it a year or two and you'll run through these on good hardware in no time is what I'm guessing. AI is moving fast

                                    Hey guys can you please share your experience with Video background remover tools ? What software (workflow) do you use ? Guess there are programs that benefits of the AI compute power of todays PC GPUs ! As i know Adobe After Effects and Da Vinci Resolve Magic Mask can do the job . Is there any good dedicated tool for this ? Thank you in advance !