koobas.hobune.stream
Best way to place 3d objects on 360 video,What is the best way to place 3d objects on 360 video?
Using AR foundation it is possible to place 3d objects so they appear to be in the real world when seen through a phone camera. Is it possible to achieve a similar result using prerecorded video, more specifically 360 video.
So far, I have achieved this by using markers. But I would love to be able to do it without markers, similar to how AR foundation can estimate surfaces and depth information.
I assume that AR foundation is using both the camera frames and IMU data to estimate depth information and the cameras pose in 3d space, using something like structure from motion. So using pre-recorded video without IMU data will probably not be sufficient for using this method. However, with my application running on a VR headset, the headsets IMU could potentially provide at least rotational data and an ingame camera could provide the camera frames.
Is this something that is possible or will be possible in the future? Or do you have suggestions for a different approach?
