koobas.hobune.stream
With the use of a plugin called AVPro we could use our 4k videos inside the hololens
Hololens 4K 360 Video Possible?
We have been filming the past few days with the GoPro Omni, so we have a lot of high quality 4K footage for a 360 Hololens tour.
After trying the native Video Player component we have discovered that the playback is very slow and tends to skip frames. We are using efficient unlit shaders too on the video sphere. Using the VideoPlayer.Prepare() method doesn't seem to do much for the CPU spikes.
So my question is 4K playback on the Hololens feasible? I have managed to get a smooth playback by loading the individual image frames in to a texture array, then looping through and setting the material texture. A float variable is used to set the framerate. However this is RAM heavy as a 4 second video uses 100 4K .jpg files. 1080p footage is very pixelated as we discovered with footage from the Ricoh Theta S but the performance is fine. Should we stop thinking about the idea of using 4K Video spheres in Hololens and stick to the texture array method?
Any opinions on this subject would be much appreciated. Thanks
Same issue here.
I've seen several examples of 4k video playing at 60fps on mobile (most recently at Oculus Connect a couple weeks back) - so clearly the hardware is capable on modern mobile devices. I do recall John Carmack mentioning that the Oculus API prefers to decode video to their back end sphere, rather than routing through Unity's pipeline - so perhaps this indicates some slowdown in Unity? But I speculate.
Anyway, would love an answer on this topic myself. Sorry I can't offer more help.
I can confirm playing back 4k 360 video at 60fps is possible on HoloLens. By utilizing the AV Pro asset store solution (https://www.assetstore.unity3d.com/en/#!/content/57969) we were able to play back videos.
