How did we do? We’d love to know your thoughts on this year’s conference. Take the survey here
As far as I know, Apple hasn’t opened access to the Vision Pro camera for developers yet, so I’m trying to find possible workarounds within the current capabilities. I’m wondering if there’s any way to apply a mesh to a person in the scene in Vision Pro, or if there’s an alternative approach to roughly detect a human shape in front of the user?
Hello, since visionOS does not allow the camera to be called, you can only use the advanced API provided in ARKit, Scene reconstruction's MeshAnchor (https://developer.apple.co M/documentation/arkit/meshanchor) generates the grid of the user environment. However, please note that this function cannot draw a grid of any human, nor can it draw a table of real-time moving objects, and you cannot draw a grid of a human in the case of non-enterprise API. You can use feedback to tell Apple about your needs.
Hi @jwus1
Take a look at Enterprise APIs for visionOS. If your app qualifies for an enterprise license and the Main camera access entitlement, you can access the main camera. For more details, see Accessing the main camera.
There's no supported way for you to apply a mesh to a person in the scene in VisionPro with the APIs currently available. If you'd like us to consider adding the necessary functionality, please file an enhancement request using Feedback Assistant. Once you file the request, please post the FB number here.
If you're not familiar with how to file enhancement requests, take a look at Bug Reporting: How and Why?.
That said, visionOS does offer APIs for scene reconstruction , but scene reconstruction's refresh rate make it best suited for static content and not dynamic content, like people.