How to watch AI Passthrough vids with HereSphere or locally?

doublevr

koreanman that's likely drm that only works with their player

BursVR

I think I have this same issue too. And I noticed it just now after I've downloaded/spent 14 out of my 30 downloads quota.. (almost 250GB!)

If I recall correctly there has been an issue with the non-AI alpha PT in the past too. I had to append "_ALPHA" before the ".mp4" extension for some videos, and I had issues streaming via DLNA, so I had to copy the video internally on my headset for it to work the same way when I was streaming it. That was recently fixed, and it's not the same issue with AI alpha PT as I see it.

Now with this new AI alpha PT, I've been trying to figure out what's going wrong for at least an hour, and I'm still confused. When I enable the PT option, I just get a very transparent image and it's impossible even to see what is happening. I only see that the "Alpha" option is enabled, but not "Alpha AI" which I see when streaming videos.

So, will I be able to watch these downloaded videos when the issue is fixed, or will I have to redownload them all over again? I still cannot see what is that the app is doing on top of the AI alpha PT videos that I'm streaming, compared to the same ones that I'm downloading right now. There should be an easy fix to make the app treat these local videos the same way as the ones that we're streaming. Or not?

EDIT: in the meantime, I did find videos that somehow worked (but only via DLNA for some weird reason), but other ones I had to delete as they were unusable. I still don't see a pattern for why some videos would work, but at least I have locally some of them (about every third). I'm aware this AI alpha PT is in beta, and that the app might not work perfectly for all supported platforms, but I think features should be tested better before release, especially if you offer them to members who are paying for the service. There's no point in downloading (and wasting time) for something that doesn't work the same way as if it was streamed. Paying more to my ISP, and decreasing the already limited download quota here on SLR is not what I had in mind.

boboweb

I think its not right SLR to keep the AI PT just for current membership users ! Once you pay for membership you get the right to download specific number of vids . So if these vids are Alpha PT you can watch them locally whenever you want. The same MUST be and with the AI PT vids . But SLR continue to be greedy and and they extort you to pay for membership anytime when you want to watch an AI PT vid . Sorry but someone needed to state the obvious and seems this is me ...
I bet there is NO any technical issue these AI PT vids to be watched locally if SLR allow this ! And bet very soon will be developed alternative FREE software for this - then SLR will be the big looser again ...

sunkenlust

As a subscriber I'd like to have them as well.

I'm 99% sure there's no technical reason we can't download the AI passthrough files, it's just that they're security locked to the DeoVR app. I went digging around in the DeoVR cache files on the VR headset and found the URLs of the files (called 'pov_mask.asvr'), but a signature variable prevents one from downloading them in a regular browser.

Although HereSphere hasn't been programmed to make use of them yet, it might in the future, and I'd like to have them on file when the feature goes live for 'offline' viewing, as I prefer HereSphere to DeoVR.

I suspect this is a business strategy, and I don't like either. More of the "You'll own nothing and be happy" economy.

BursVR

The new AI passthrough videos (not AR videos, those are different) are just like the old regular ones; it's just that the AI filter is applied in real-time on the headset itself. Most of them are even without alpha masking, so kudos to the team for making it perform so well even on the mobile chipsets and up to 8K/60fps resolution.

The issue for me is that the passthrough for the local videos doesn't render properly. I get either some semi-transparent picture, or letters ~~of the studio that made the video~~ for the entire length of the video, or simply nothing at all. Either some metadata (like a JSON file instructing the app on how to play videos) is left on the server, or the app just intentionally (or in a buggy way) handles the same video streams differently. I don't see what else it could be.

A similar thing was happening with the old videos where RGB masking/passthrough was applied on the fly. First, the videos needed to be manually renamed with "_alpha" appended to the filename, and then all alpha color parameters needed to be set like in those streaming videos (that were already predefined). Luckily, we have to set these only once, so the app caches it and uses it the next time. Just be careful with the "clear browser cache" option within the app; it's pretty aggressive if you ask me, and it could wipe those color settings too.

EDIT: correction on "the letters of the studio that made the video" mentioned above - it's actually this message:
"Watch the video with SLR app or DeoVR player", plus the filename and some other stuff that's hard to read for me.
Well, I'm using DeoVR ?! And I downloaded the video with my SLR account. So why the app is refusing to play it ?!

SchnuppiLilac

BursVR I don't think it's true what you are saying about AI PT being generated on your headset for downloaded videos. I think what you did is activating alpha PT in DeoVR and what you are seeing is a result of that. You can hover with your pointer over the PT icon in the player UI to confirm that it's alpha, not AI PT.

BursVR

SchnuppiLilac Sorry, but where did I say about AI PT being "generated" on my headset for downloaded videos? On the contrary, I'm unable to make that work, and that's actually the issue I was describing in my initial post. I know I wrote a lot of things, but maybe I was misunderstood.

I'm aware of the PT icon, and the video I downloaded clearly has "AI" beside the icon. When I'm streaming, it works, but when I download the video, it doesn't (and it says I should use the DeoVR app, which I am using to play it). The other ones that have "+" beside the icon are packed with alpha channel, and the old ones (call it 1st-gen if you will) are chroma-keyed, and both of these are working just fine with downloaded videos. Just not these new ones with AI.

The AI filter works in real-time on the headset for sure (there are a few posts around), so I don't see the reason why it can't work with the downloaded videos too. I'm quite sure it's the AI videos I'm having issues with, because they are still not perfect, and have less precision cutting out the background than the ones with packed alpha channel, so it can be often obvious which is which.

SchnuppiLilac

BursVR I understood your problem is that (you think) you have downloaded an AI PT video and it turns out that AI PT does not work when you play it. Did I get this wrong? What I was trying to say is that right now you cannot download the AI PT part of the videos with the AI PT icon. What you are downloading is just the regular VR video but not the mask that makes it AI PT which can only be streamed. And if you try to play these regular videos locally and you are getting the semi-transparent look or "Watch the video with SLR app or DeoVR player", it is because you switched on alpha PT in DeoVR which is not intended for regular VR videos.

It is probably possible to make AI PT work for local videos but for this you will need to download the mask separately and this is not possible at the moment.

sunkenlust

BursVR : The AI passthrough mask is contained in a separate video file, and SLR appears to have put security in place to prevent subscribers from downloading that file. Maybe there is a technical reason the headset can't combine a local file with a streamed file in the DeoVR app...perhaps harder to get them to sync. But I would think it should be possible while maintaining the security. If both files were local, my guess is combining them would be easier than syncing the 2 streams. If you jump around the cuepoints in a AI passthrough video, you can see the streams go out of sync for a moment.

Hairsational

SchnuppiLilac this is not possible at the moment

It is actually

BursVR

Ok, I get it, what you say might very well be true. I thought this AI mask works the same way as alpha-packed MP4 files. But then again, when the AI model gets smarter, that would mean the videos should be reuploaded. And that would be, well, very inconvenient to say the least, considering the sheer amount of SLR content. And believing the headset itself did this heavy lifting with AI filtering was a little bit of naive thinking for me. So, it's probably that separate AI mask stream/file that I'm missing in my downloads folder. It makes sense. Now, let's find a way how to download the "offline" AI mask 🙂

BursVR

Hairsational Care to explain how? I would be very interested as I haven't found a way to do it. Thanks.

SchnuppiLilac

Hairsational It is actually

You mean by ways no subscriber would ever use or even talk about because they violate the ToS?

Hairsational

BursVR To clarify, I mean downloading the mask. I'm not sure if DeoVR allows local PT even if you have the mask files though.

Silly-Sausage

sunkenlust They should release the AI Passthrough tech to other studios on licence or even to users so they can create their own masks of previously downloaded files.

I have so many scenes that would benefit from a passthrough mask and i know a 'Drive' is coming, but that will have too many restrictions due to the size of uploads and ongoing costs involved, server space and the usual price increases with this sort of thing.

Hairsational

SchnuppiLilac The chances are that it is against the ToS, but that has never stopped people from consuming content how they want to. Take YouTube Vanced, for example.

sunkenlust

Silly-Sausage : Here's another idea...I put my SLR credentials into HereSphere and then I get access to all the AI passthrough matte streams, which the HereSphere combines with the videos. Win-win, SLR gets their subscription money for the tech they've developed, and I get to use the VR player I want.

Of course the HereSphere dev would have to build this in to his app, because it doesn't have this feature yet.

Silly-Sausage

sunkenlust Sounds good, but i think both our great ideas are very unlikely

sunkenlust

Silly-Sausage : Maybe. AI background removal seems to be everywhere right now, getting incorporated into smart phone photo software and desktop editing software. Maybe SLR is even using one of the free open source tools out there. If SLR won't let subscribers download their matte files, maybe we can start making our own because the tech will be so ubiquitous. HereSphere would still need development work to make use of them in the future.

Silly-Sausage

sunkenlust If SLR won't let subscribers download their matte files, maybe we can start making our own because the tech will be so ubiquitous

Too be honest i'm too lazy to be bothered with all that stuff these days and if somebody does something well then i'm happy to pay them for it, for now

sunkenlust

Silly-Sausage : I thought I'd run some tests using an AI powered background removal After Effects plugin. On the lowest (least accurate) setting 1 hour of 4K 60fps footage takes about 6 hours of rendering. This is on an M1 MacBook, still considered a fairly fast computer (even though 4 years old). So it takes a bloody long time to make these mattes. Now I know why it's taken some time for SLR to go through their library; they probably have a small farm of computers working on this. Not so easy to do it yourself.

Next Page »