[AR] Apple Vision Pro x Unity Polyspatial

Build recordings

Highlights

  • Led a 4-people team at 2-days XR Hackathon, hosted by MIT Reality Hack, sponsored by Apple, Meta, Unity, Qualcomm, Snap
  • Built AR demo with Apple Vision Pro Simulator and Unity Polyspatial beta SDK to simulate sports environment for training and/or audience tools
  • Reported SDK bugs regarding Apple Vision Pro emulator graphics issues and discrepancy with the Unity editor preview to Unity Professional Services team
    • The objects implemented in Unity Editor are not occluded in Apple Vision Pro Emulator. It is because the objects are virtual, not being fed by a real camera of Apple Vision device.
    • Unity camera's setting in screen space overlay does not work in Apple simulator. We had to choose screen space camera but then it moves along the camera view and too shaky.
    • Unity only handles the game mechanics and interaction algorithms, while Apple vision pro handles all the graphics and final renderings. That is why it is hard to control the graphics problems from Unity editor side.
simulator 2
Final rendering in first-person view
simulator 1
Build rendering in third-person view

Building a Apple Vision Pro Simulator Scene in Unity

unity 10
Replicating one of the Apple Vision Pro sample scene: Gallery
unity 11
Customizing Character Walker scene for VisionOS
unity 7
Customizing Character Walker scene for VisionOS
unity 6
Waypoint algorithm for charact walking
unity 7
Customizing Character Walker scene for VisionOS
unity 5
Adding UI components in Unity for VisionOS

Unity Polyspatial Build Setup & Troubleshooting

unity 2
Apply Vision Pro and Unity Polyspatial SDK licenses
unity 0
After you have Unity Polyspatial license, you can import plugins
unity 1
When you build, choose visionOs platform. Check xcode version if you encounter build issues later.
unity 3
Building Apple Vision Pro Sample scenes with Unity. Warning message is due to graphics rendering difference between Unity and Apple Vision Pro.
unity 4
URP material warning in Xcode build
xcode 2
If you have multiple xcode versions, make sure you select the compatible one