Occlusion Passthrough Update
I agree with this. It's also the top feature I would be looking forward to.
doublevr I'm looking forward to this please keep us updated
I saw a review of 'stranger things' on quest. It has a mixed reality section, in the video you could see his actual hands over VR assets, seems like it basically just used the hand tracking for position to cut out the hands. We must be close to this...... Surely! It's next level stuff.
Repaelleinad it's coming
Quick research conclusion:
- We might use dynamic occlusions to render video behind user's hands
- It cannot be used to move your hand in the space of the video (let's say you want to move your hand behind one girl, in front of another) - that requires 3D objects, not stereo image. Requires deep research to figure out such usage. We might come back to this idea later.
Integration:
- Requires heavy modification of the image rendering
- Most likely will affect performance (FPS drop, can't predict how much)
- Makes more sense for 3D objects and volumetric scenes with "real" depth
We will try to make simple integration with hands in front of the rendering mesh first and see where it can lead us
Stay tuned!
So how will that work while fapping, the occlusion should be an option, turn on turn off. Toggle switch.
Vrsumo2017 yeah, that's a good question
We will share experimental builds if we manage to make it not that intrusive
- Edited
Check this out. This is what can be done (potentially).
Let's see if we have enough interest to implement it.
Keep in mind:
- Rendering performance drops
- It's not really easy to improve quality (flickering on the edges, etc) without losing more performance
- This only works on Q3 at the moment
How cool is that?
iddqd Perfect! btw can it be optional too?
iddqd This is awesome and when can we expect this?
Nice, already looks cool! Curious to try it out. It might not be perfect yet but tech has to start somewhere, meta will keep improving the algorithm, hardware will keep getting better, etc. So, it's a yes for me. Make it toggable though and also assignable to a hot key for quick switching.
Looka good, will th8s be an option?
On the real, that looks badass!
iddqd You already have a player with really bad performance and this gimmicky feature will only make it worse
- Edited
Brilliant, I knew it would be a little janky due to the way it has to be done on Quest but it's there! Obviously it would look perfect on Vision Pro but who has one of those but it's worth implementing now as the next Quest (not Q3s) will have this nailed like on vision pro. Can't wait for it to go live! Great job!
P.s. You gave it a worst case scenario there, fingers wide open is what it struggles with so it will look better if a person is not trying to break it by doing things you wouldn't naturally do.
- Edited
Repaelleinad Brilliant, I knew it would be a little janky due to the way it has to be done on Quest
Of course it would be, Everything in VR is essentially in a beta state "janky". I'd rather have something now and see it improve over time than wait another decade for perfection, just because a few people say, 'Why release this now if itβs not ready?' It's VR, updates and improvements are part of the process.Even AVP doesn't look super refined in terms of occlusion yet, but that's still in beta too.I'm hoping there's an option to toggle these features on or off. It's always good to have options."