Reconstruct real room using video for transition
I'm attempting to create a VR game and I wanted to use real rooms taken from pictures. In my scene I would transition from one room to another.... Think mystery game. Here is my challenge and idea.
The house I want to use is a real house so my idea was to take a spherical equirectangular picture and using it as the scene that the user looks around in. Since it is 360 user can look left and right and up. However when I transition to another room I would like to have an effect where it looks as if the user is actually walking. For this I do not want to reconstruct the entire scene in 3d. My idea was to record a video and then when the user goes to the next room the video plays of the person moving to the next scene. How would I achieve this in unity? Also I'm not stuck on this idea if you can suggest a simple way to reconstruct a 3d scene I'm open to it. Thank you!