UNET - Hololens support

I have UNET working fine with hololenses except the following major challenge

1. When it spawns the player object in each client it creates its own instance and synchronizes the movement. This is fine in a computer based game application. In Hololens, in our app, we need to show that all the instances look the same and spawned at the same location and movement look exactly the same in all lenses. The best analogy is a presenter presenting about a tiger using his hololens and all the audiences are using their own hololenses looking at the same tiger. Hope I had explained it clearly.