User Interface Service Software Developerís Guide - Hitech Projects

January 2008
Public
3.2.3.4 Configure .......................................................................................................................................................79
3.2.3.5 Compile..........................................................................................................................................................79
3.2.4 Multimodal Fusion ...............................................................................................................79
3.2.4.1 System requirements......................................................................................................................................79
3.2.4.2 Download.......................................................................................................................................................80
3.2.4.3 Install..............................................................................................................................................................80
3.2.4.4 Configure .......................................................................................................................................................80
3.2.4.5 Compile..........................................................................................................................................................80
3.3 Component Architecture ..........................................................................................................81
3.3.1 Implicit speech input component interface...........................................................................81
3.3.2 Gesture Service.....................................................................................................................82
3.3.2.1 2D Gesture service interfaces ........................................................................................................................82
3.3.2.2 GestureInterpreterService..............................................................................................................................82
3.3.3 Multimodal Dialogue Manager ............................................................................................83
3.3.3.1 Limitations and scope of services..................................................................................................................83
3.3.3.2 Integration with the Context Management Service.......................................................................................84
3.3.3.3 Dialogue Manager Internals ..........................................................................................................................85
3.3.3.4 Component interfaces ....................................................................................................................................87
3.3.4 Multimodal Fusion ...............................................................................................................87
3.3.4.1 Component interface......................................................................................................................................87
3.4 Tutorial.......................................................................................................................................89
3.4.1 Gesture Service.....................................................................................................................89
3.4.1.1 2D Gesture Service ........................................................................................................................................89
3.4.2 Multimodal Fusion component development.......................................................................91
3.4.3 Multimodal Fusion application development.......................................................................91
3.4.4 Dialogue Manager ................................................................................................................94
3.5 Assessment .................................................................................................................................95
3.5.1 Voice Service .......................................................................................................................95
3.5.1.1 Implicit Speech Input.....................................................................................................................................95
3.5.2 Dialogue Manager ................................................................................................................95
3.5.3 2D Gesture and Multimodal Fusion .....................................................................................95
3.6 Appendix ....................................................................................................................................97
3.6.1 Multimodal Fusion sample files and messages ....................................................................97
3.6.1.1 Properties file for time windows: ..................................................................................................................97
3.6.1.2 MMIL message example for gesture.............................................................................................................97
3.6.1.3 MMIL message example for selection ..........................................................................................................97
3.6.1.4 MMIL message example for sentence...........................................................................................................97
3.7 GUI-Service Component Overview .........................................................................................98
3.8 Deployment GUI Service ........................................................................................................100
3.8.1 System requirements ..........................................................................................................100
3.8.2 Download ...........................................................................................................................100
3.8.3 Install..................................................................................................................................100
3.8.4 Configure............................................................................................................................100
3.9 Component Architecture GUI Service ..................................................................................101
3.9.1 Interfaces ............................................................................................................................102
3.9.2 Classes of the UI-Service ...................................................................................................103
Amigo IST-2004-004182 4/114