App for Samsung XR headset?

harigeharry

Reeses Well actually I just had a breakthrough 🙂 I managed to get passthrough working for the left eye, works perfectly now, yihaaaah. Lot's of trail and error using Grok to get the shader right but somehow I managed to figure it out 🙂 The right eye is slightly more complex (the mask is divided in 4 instead of 2 for that eye), but I'm confident I can get that going too. So really nearing completion now. Problem is still getting it in the appstore, going to see if I can get that going.

blaze466

Hough Hou released a new VR180 app in the Google App Store that is an improvement over the native app. It only plays local files and is very simple, but the best part is the slider only comes up when you click (hands or controller).

harigeharry

blaze466 Damn so the guy beat me to it, LOL. Well good for him. And for anybody who want a bit better player than the Samsung one. My app is about ready too, I've got passthrough working now (just regular PT of course, like said, for AI PT you'd either need to reverse engineer the SLR server connection and connect to SLR just like the DeoVR app does, not sure if SLR would even be ok with that but I'm also not planning to do so. Thinking of it, reverse engineering wouldnt even be necessary, you'd need permission anyway from SLR and in that case I'm sure they'd just explain how to connect. And the alternative would be to manually download the mask indeed and then manually create an alpha packed file.

Either way, really happy I've got PT working now. Grok put me in the right direction but like I already thought, totally writing that shader part by itself, that's still a bit beyond current AI capabilities. But once you understand what you're doing it's not too hard to implement it, but still, happy it works 🙂

But getting it to the app store is the challenging part here, still working to get a DUNS number.

Reeses

blaze466 I tried searching that name and can't find the app, you got the name of the app my friend?

blaze466

harigeharry There is still room for a good app with more features. If you can get yours into the store, it’s probably still worth it. Would it support streaming by chance? I’m getting the impression that’s a no.

harigeharry

blaze466 yeah mine supports streaming from a local server.

harigeharry

BTW it's really too bad that Samsung cheaped out on their processing unit. It's nearly impossible already to push out steady 90 hz 4k, it usually misses around 10-15% frames already and then the headset starts heating up, fans kick in and everything starts to throttle and gets even way worse... not sure if thats' the reason that the webplayer from SLR only uses 72 hz instead of 90 hz. Maybe with an extremely optimized engine it's possible but with AVpro it seems hard.

BTW I only today realized that with the new hyper app, Deovr implemented their own engine, which seems better optimized than AVPro. Too bad it seems that they're not planning to support our Galaxy XR.

Either way, will try to optimize things a bit more and see what I can do

blaze466

harigeharry Agreed. I think the expected foveated rendering to reduce the load on the chip.

harigeharry

Actually I managed to optimize everything 10-15% so now I'm at almost no frame drops anymore, 90 hz, and only slightly lower than 4k rendering. It looks pretty damn amazing, if I may say so myself 🙂 Substantially better quality than the SLR website streaming.

Will try to optimize even more.

blaze466

harigeharry Hell yeah.

harigeharry

Damn I'm actually starting to hate this headset. I mean I really optimized things a lot, got CPU now at 50% which is really good (better than anything I've seen out there) and GPU at about 85% which is ok-ish and about the same as other apps. But after watching video for a few minutes the headset starts to heat up and starts to throttle.

And it's not just my app, it actually does the same with all video players. The one posted above, from that chinese guy, the samsung one, the SLR website, it's all the same. When the headset is cold, everything is fine. But play a high-res video for a couple of minutes and you'll start to hear the fans kick and in and before you know it, you'll have 50% frame drops.

There's just NO WAY you can have 4k@90hz video for 10 minutes. Not even 4k@72hz. I think not even @60hz. Damn Samsung really messed this up. Awesome panels but extremely underpowered chipset and/or insufficient cooling capacity to drive them. It's sad.

Actually it's frikking crazy, just staring at the empty desktop, no apps running, results in CPU and GPU load at about 50-60%

harigeharry

Yeah just tested it, even 4k@60hz can't be sustained for 10 minutes on this headset before throttling kicks in and frames start to drop. Oh well, it is what it is. The quality is just frikking amazing, blows the Vision Pro out of the water but because of the better chip, I think the AVP2 is currently the best high-end porn headset out there. No frikking thermal throttling after a few minutes there.

Anyway, waiting for my DUNS number to release the app, I hope I can get it on the play store this week.

harigeharry

But yeah I'm thinking now, it was all to be expected. I mean if Samsung chose to render the desktop in that frikking low resolution instead of just 4k (like the AVP does), then that was the super red flag of course already. The whole reason that they're not rendering the desktop in 4k is that that would already have the GPU/CPU thermal throttle and drop frames even before an app has started. So yeah, the 4k display panels in this headset are more like a gimmick, since it just lacks the power to sustain rendering at that resolution. I think if you don't want thermal throttling, you'll need to render at 2.5k resolution, which seems to be about the desktop resolution, maybe it's even lower.

Of course it's still a better headset than the Quest 3. But I wouldnt advise anybody to buy this headset anymore. Either buy the Quest 3, or if you have the money, the AVP2.

If samsung would offer a V2 this year with stronger CPU/GPU I'd buy without thinking twice. But somehow I doubt they'll release that.

harigeharry

Tested some more, the positive thing is that it throttles less with non AI videos (shader of course need to calc less) and that the thermal throttling is not constant, it might throttle for like 10-20 sec and then get back to full frame rate for a while. So it's not as bad as I initially thought. Still, I wish Samsung had just used slightly faster CPU/GPU

harigeharry

Sorry for all my crazy guy rambling here, LOL, but I just did some more A/B-ing between the AVP and Galaxy XR and honestly I must say I can't go back to the AVP. The XR's image is just substantially better. If I have to play it at 60 hz, so be it, still looks quite a bit better than the AVP.

blaze466

I agree with you on the chipset. I would have paid several extra hundred bucks to get a better chip.

I assume you are running 2.4 GHz WiFi? My performance improved significantly when I switched to that from 5 GHz. It’s not perfect, but way better.

And, while I don’t have an AVP, I can’t go back to my quest either. The visuals are stunning. I wish we could push the screen to the max though. It would be pretty near human vision quality if the chips could handle even 10k, let alone 12k. I know only one camera can even get that resolution right now, but it sucks knowing the headset will never be able to run those when they come out. Unless, maybe, just maybe foveated rendering can be built into the player.

harigeharry

blaze466 Hmm I tried switching 5 ghz to 2.4 ghz, it didnt make any cpu utilization difference. I think it might be a problem in your local network setup, I think normally 5 ghz is better for high bitrate streaming.

About the higher res: I can safely say: forget about that with this headset. Even 4k rendering @ 90 hz is pretty much impossible for 10 minutes. 72 hz can be sustained if you play a regular 180 degree video. But add fisheye or alpha masking to the mix and you cant get higher than 60 hz without thermal throttling kicking in after a few minutes. So the chipset honestly isn't even good enough for 4k@90hz rendering, so forget about even higher.

Cydewayz

the devs at the website needs have an option to turn off hands modes if controllers are connected since this has cause nothing but issues for me cant even use the site

harigeharry

My app is ready. My Google Play developer account is under review, "This may take a few days" it says, so hopefully in a few days my app will be on the play store. It's basic but it does all i want myself from an app: hide the menu, no 'accidental' menu activation, you can choose which hand to use, you can move the menu around on the screen, you can stream from a local (jellyfin) server or just play from the headset and you can rotate video with your hand. It scans the filename and sets the lens type accordingly (for example equirect180 or Fisheye190 Alpha for passthrough). You can set the refreshrate (60/72/90hz). And all that of course in the highest possible video quality, way better than streaming from SLR (if you have downloaded the HBR quality version of the SLR original of course).

With this headset (and app), the difference in quality between studios becomes super visible, SLR originals in HBR quality is VERY lonely at the top, the rest of the studios and other websites out there dont come close. For example I personally love the "Virtual Papi" productions for their models but damn, their quality is SO far behind from SLR originals... But also compared to other websites, most look quite bad compared to SLR and honestly nothing even gets close. It's actually a bit sad because I don't even like the other video's anymore, LOL, the only content that is worth playing on this headset is SLR originals at HBR quality.

Cydewayz

harigeharry please let us know when your app is ready. So you implemented local files can you do the scripts as well?

harigeharry

Cydewayz Hmm dont have any device myself, so for the moment no. But if the app becomes a success, I'll look into adding that.

Reeses

harigeharry with that front you could probably reach out to yoooi, he built multifunplayer, and it links to multiple player apps. Bet he could link to yours.
https://www.patreon.com/posts/multifunplayer-2-106378593

« Previous Page Next Page »