I have a neural network model for segmentation, I successfully integrated it and am getting a grayscale image. Next, I need to apply the segmentation mask in RealityKit to achieve the occlusion effect (like person segmentation). I tried doing it through post-processing and other methods, but none of them worked. Is there any example of how this can be done in RealityKit?
How did we do? We’d love to know your thoughts on this year’s conference. Take the survey here
How use custom segmentation occlusion in RealityKit?
After conducting a large number of experiments, I achieved the desired visual result.