How to use multi-threading on Hololens

Question

We're trying to use multi-threading on the Hololens, but fail.

Currently our App is running to many operations in the main-thread that if we start our "live-stream" (working with WebcamTexture) the Holograms don't appear anymore.

So to start of with we want to ask how could we use threads run parts of our photocapture-code (seen below) more efficiently? So we can understand which parts to run in different threads.$

We're using Unity 2018.4.10f1

 using UnityEngine;
 using System.Linq;
 using UnityEngine.XR.WSA.WebCam;
 
 public partial class PhotocaptureFrame : MonoBehaviour
 {
 
     public PhotoCapture photoCaptureObject = null;
     public GameObject quad;
 
     public static PhotocaptureFrame Instance { get; set; }
 
     private Texture2D imageTexture;
     private CameraParameters c;
     private Resolution cameraResolution;
 
     private void Start()
     {
         cameraResolution = PhotoCapture.SupportedResolutions.OrderByDescending((res) => res.width * res.height).First();
 
         PhotoCapture.CreateAsync(false, delegate (PhotoCapture captureObject)
         {
             photoCaptureObject = captureObject;
 
             //CameraParameters c = new CameraParameters();
             c.hologramOpacity = 0.0f;
             c.cameraResolutionWidth = cameraResolution.width;
             c.cameraResolutionHeight = cameraResolution.height;
             c.pixelFormat = CapturePixelFormat.BGRA32;
 
             captureObject.StartPhotoModeAsync(c, delegate (PhotoCapture.PhotoCaptureResult result)
             {
                 photoCaptureObject.TakePhotoAsync(OnCapturedPhotoToMemory);
             });
 
         });
 
         Instance = this;
     }
 
     public void MakePhoto()
     {
         PhotoCapture.CreateAsync(false, delegate (PhotoCapture captureObject)
 {
     photoCaptureObject = captureObject;
 
     captureObject.StartPhotoModeAsync(c, delegate (PhotoCapture.PhotoCaptureResult result)
     {
         photoCaptureObject.TakePhotoAsync(OnCapturedPhotoToMemory);
     });
 
 });
 
     }
 
     public void OnCapturedPhotoToMemory(PhotoCapture.PhotoCaptureResult result, PhotoCaptureFrame photoCaptureFrame)
     {
 
         Resolution cameraResolution = PhotoCapture.SupportedResolutions.OrderByDescending((res) => res.width * res.height).First(); // Create our Texture2D for use and set the correct resolution
         Texture2D targetTexture = new Texture2D(cameraResolution.width, cameraResolution.height);
 
         photoCaptureFrame.UploadImageDataToTexture(targetTexture);  // Copy the raw image data into our target texture
 
         imageTexture = targetTexture;       //Save image to new Texture to not loose it
 
         quad.GetComponent<Renderer>().material.mainTexture = imageTexture;     // Do as we wish with the texture such as apply it to a material, etc.
                                                                                //photoCaptureObject.StopPhotoModeAsync(OnStoppedPhotoModeEnd);
 
 
         // Clean up
         photoCaptureObject.StopPhotoModeAsync(OnStoppedPhotoModeEnd);
     }
 
     public void OnStoppedPhotoModeEnd(PhotoCapture.PhotoCaptureResult result)
     {
         photoCaptureObject.Dispose();
         photoCaptureObject = null;
         Debug.Log("Photo object disposed.");
 
     }
 }

Thanks allot any help is appreciated

Answer 1

Answer by thelghome · Nov 25, 2019 at 02:06 PM

FMETP STREAM supports HoloLens Live Streaming, encoding/decoding with multi-threading. https://youtu.be/1zh3VkwhIag

Asset Store: http://u3d.as/1uHj

Add comment · Share

How to use multi-threading on Hololens

1 Reply

Your answer

Follow this Question

Related Questions