A snapshot from the first ADAMAAS protoype, which combines gaze and gesture integration in the 3D situation model.

The combination of several modalities, such as eye movements and body movements, both by the wearer of the eye-tracking system and potential interlocutors, is currently only implemented in the internal research prototype.

A description of the approach can be found in our recent paper presented at ETRA 2016.