Multimodality Manager

Being able to engage in multimodal interaction is one of the key features of smart products. The Multimodality Manager provides the necessary functionality to the SmartProducts platform. It introduces a level of abstraction above the individual interaction resources which are found in the current environment, allowing the smart products developer to treat different, and potentially changing, interaction environments in a uniform way.

The main abstractions provided by the Multimodality Manager for the smart products developer is the notion of user interaction. A user interaction can be characterized as one turn in the dialogue between end-user and smart product. Thereby, it contains the output from the smart product (if applicable) and the input provided by the user. The output is generally specified using HTML plus XForms. The input is represented using EMMA.

Developer: Daniel Schreiber