User Interface Service Software Developerís Guide - Hitech Projects

January 2008
Public
• load the JaviMap file using command "javi "
• load the background image P with "back "
• save the scene (map+background) using "save "
• edit the scene to add the objType or other features of the objects
3.4.1.1.3 Complete tutorial (with Oscar)
0- achieve the needed requirements, run the OSGI framework (it is normally loaded when you
start Oscar) and the required AMIGO services (see the Requirements in the Deployment part)
1- compile each service (gesturecapture, gestureinterpreter, sceneconfigurator) with "ant",
and copy the jar files located in the dist directories of each service, to the
$OSCAR_HOME/bundle directory.
2- run the services (in this order) :
start file:bundle/gesture-capture.jar
start file:bundle/gesture-interpreter.jar
start file:bundle/scene-configurator.jar
Normally the gesture capture frame and the configuration frame should appear.
3- configure them by first copying the GestureCapture etc directory containing sample scenes
into the $OSCAR_HOME directory. Then push the button “configure” and choose a scene you
just copied. You can change the location of the scene files providing that the url they contain
remain valid (in the sample scenes they are relative to $OSCAR_HOME directory). Normally
the scene should appear in the gesture capture frame.
4- test some commands. For example type « show * » to show all the objects, type « ls » to
list the objects, ...etc.
5- select objects with a mouse or a tactile pen. You can target, point or circle the objects.
Check the Oscar windows, you should see that the interpreter sent a GestureSelection event
containing all the selected objects associated to salience measures. This GestureSelection
event is intended to be consumed by the MultiModalFusion agent, but any module can use it
also.
6- now you can use the FillerDemo developed for the AMIGO november 2006 review. This
service shows a possible use of the output of the GestureInterpreter : it does nothing else than
highlighting for few seconds the selected objects according to the saliences found in the
GestureSelection event. Compile the filler-demo service with "ant", copy the jar file in the dist
directory to the $OSCAR_HOME/bundle directory, then run the service :
start file:bundle/filler-demo.jar
7- then load the appartment scene and selects the objects. You should see that the objects
are more or less activated according to your gesture. Note that if you try loading the man
Amigo IST-2004-004182 90/114