• Support
  • AI Passthrough bugs and improvements thread

With v64, we’ve made a number of improvements to Passthrough on Meta Quest 3. Passthrough is now higher-fidelity than before, and better at adjusting color, exposure, contrast, and dynamic range to match your real-world surroundings.

Taken together, these improvements should make it easier to, for instance, see fine details (i.e. phone notifications and other small text) without removing your headset. Passthrough is also less grainy in low-light conditions, which should be helpful for late-night gaming.

https://www.meta.com/en-gb/blog/quest/meta-quest-v64-update-passthrough-improvements-external-microphones/

    So if I get it right about pinch and drag - you would like to drag the video dome (change transform settings of the video) using hands (or controllers I suppose) with the easiest interaction.
    Do I understand it right, @Vrsumo2017 ?

    We will put this improvement into development a bit later.
    Currently we are focused on releasing the app for Apple Vision Pro and improving Input System (how controllers work).
    After these we can focus on UX improvements.
    Thank you for your input!

      iddqd yes, pinch drag the image with dome rotation using hand trackingπŸ‘Œ

      I was using the hands βœ‹οΈ
      It's great, fun to see virtual hands over body parts, but every time I wanted to Dome rotate I have to pick up the controllers, then put em back down then activate the hands again, if I could just pinch and drag the image with hand tracking it be more convenient doing it with hand tracking instead of picking up the remote.

        VRLover69 laser pointer"

        It use to not be there unless you open the menu, after sum update it was like that with pointer all the time, I brought it up brfore a while back. πŸ€·β€β™‚οΈ

        Maybe make it a floating dot instead of laser and it only comes on when menu open.

        Lol floating boobs 🀣 πŸ€”πŸ’‘πŸ˜
        Or you could choose body parts.
        Lol but that probably be better for the actual slr vr app, might not be appropriate in deovr. Lol

        Vrsumo2017 now once I'm thinking why do we even need it if we got PT automated with predefined setup and AI?

          Our current roadmap includes:

          • model improvements to have fewer "holes" in videos, less blinking and finer borders. Old mask are going to be reprocessed when better model is ready. Give it a month or two.
          • remove shaking borders on the videos.
          • releasing PT AI on the web and WebXR.

            doublevr colud fixing 6dof be added to that, right now when ai pt or pass through is on the 6dof doesn't work right. Also if possible allowing dome rotation available when 6dof is on.

            doublevr PT automated with predefined setup and AI?

            I don't understand that, explain for dummies lol

            I use my remote to adjust the image with dome rotation If the model sitting crooked or the models are not centered, are you saying AI can adjust this for me automatically? Or in pt for example say I'm standing watching a doggy by bed and I want to move the diggy to my dresser, with the remote I hold b for dome rotation and move the image with me. But if I'm using hand tracking I have to pick up the remote.

            But if hand tracking improvements are lower on a list to do right now that's fine, was just a suggestion I thought I throw out there. πŸ‘πŸ₯‚

            Questions for 6dof users, what do you actually use this for in VR or AR?

            doublevr Also, I noticed that if there is a hole between the models arms and her body that closes. For instance when she has her arm touching her hips or something but there is space between her arms and her body the hole is never cut out.

              fenderwq I've noticed with no hands bjs the ai works good taking out stunt cock with body out but once she grabs on to it it will bring the stunt cock back in.

                I saw a few ARporn's content, idk if is the same director, looks like it or same editor doing the alpha pack but the edges are to soft, should be able to make them sharper, czechAR's videos look real sharp on the edges and it looks pretty good.

                If I can kindly suggest looking into making the hotties more sharper around the edges with alpha production videos.

                Question
                Will the AI pt ever get as sharp around the edges or will is always have minor flaws, will a slow internet effect the AI pt processing on a video?

                I notice today the AI was working great but then it was playing kinda slow out sync with video, it couldn't keep up. I was wondering if a internet connection can effect that?

                  Vrsumo2017 the alpha is backed in the part that is unused bt the fisheye circles of the movie. That's how slr alpha packed movies work. Since this space is inheretly lower resolution than the source file it's probably not possible to make the edges as sharp as Czechr vr since that works with keying directly in the app. Both have some cons and pros though

                    fenderwq Czechr vr since that works with keying directly in the app.

                    Do You mean, Czechvr are using something like the pt hack options to take out the green?

                    I noticed with alpha videos if i switch to the pt hack option and take the color out my self the edges are sharp but the it's got minor see through like on tats and sum hair but the body edges are sharp instead of kinda blur how the alpha produce videos look.

                      Vrsumo2017 no hands

                      We need more no hands bj, it happens sometimes in vr but usually its short. Do more no hands bj but last longer and no hands deep throating. πŸ‘πŸ₯‚πŸ˜

                      doublevr

                      The next most advanced solution for AI pass through is to use it in live cams that would be a game changer. Please have the Dev team work on that because we will then always be watching live cams.