Tools: Apple Vision Pro, Swift, RealityKit, style transfer

Overview

The app allows the user to look outside their window and see a 3D style-transfered version of the view using Apple Vision Pro. A number of windows (i.e. portals) can be placed in the same room and made persistent to be reloaded later. User can save and load any number of alternate views through their AVP Photos app. Initial attempts have been made to automatically recognize windows and place portals in their locations, but this didn’t work well and was replaced with a more robust manual placement system. This means portals can be placed anywhere, not sure on windows. After style-transferring the original view, the images were turned into 3D representations using the AVP Photos app.