microsoft/MixedRealityToolkit

Requesting access to Extended Eye Tracking API and enabling the custom capability.

zhimin-wang opened this issue · 1 comments

zhimin-wang commented

Describe the problem

Hi!
I'm currently working on a project that requires left and right eye gaze vectors for obtaining eye gaze depth. Current Eye tracking SDK of HoloLens 2 doesn't provide left and right eye gaze vectors, only offering the single (cyclopean) eye gaze direction and hit position.

Describe the solution you'd like

We found Extended Eye Tracking SDK provides TryGetLeftEyeGazeInTrackerSpace and TryGetRightEyeGazeInTrackerSpace functions for calculating left eye gaze and right eye gaze. The extended ET API is a custom capability. So I need to request access to the API, if I want to publish my uwp to the Microsoft Store. However, I just want to run my application on HoloLens 2 in developer mode. The document states running in developer mode doesn't need to custom capability. So I try to use the EyeGazeTrackerWatcher class of Extended Eye Tracking SDK in the Unity script, but the unity reports that "The type or namespace name 'EyeGazeTrackerWatcher' could not be found (are you missing a using directive or an assembly reference?)".

In brief, my questions can be three-fold as follows:

    1. I just want to run the Extended Eye Tracking SDK in the developer mode of HoloLens 2. Do I need to request the custom capability? If don't need, how can I compile the script in Unity that uses the EyeGazeTrackerWatcher class successfully?
    1. If need, how can I contact the Microsoft Mixed Reality team? We found the URL. The instructions request us to reach out to Microsoft Mixed Reality team (mail: TDB). However, I don't know the specfic email. I posted the question in #10230 , but it seems to have no follow-up development.
    1. If need, how can I obtain the Signature Hash of the uwp signing cert? I tried many methods but they don't work. The issue describes this question, but I also don't know how to sign the sln of Visual Studio 2019 with SHA256 cert?

I really appreciate any help you can provide.

Describe alternatives you've considered

Additionally, for our use case, falling back to single (cyclopean) eye gaze tracking is not an option.
Thank you very much.

Additional context

image

Bowen-MS commented

Hello, the extended eye tracking SDK was made public to all developers now and you don't need to request any custom capability. Just follow this site and sample app here to get the individual eye gaze vectors in Unity.