User Interface Service Software Developerís Guide - Hitech Projects

More documents

Recommendations

Info

January 2008 Public 3.4 Tutorial 3.4.1 Gesture <strong>Service</strong> 3.4.1.1 2D Gesture <strong>Service</strong> 3.4.1.1.1 Using GestureCapture command line The GestureCapture command line facilitates the scene creation by providing some commands : clear : clear the scene add : add a new object from the last drawn simplified gesture, the gesture is simplified (only important points are kept) and added in the scene as an object addfull : add a new object from the last drawn whole gesture (all the points of the gesture define the object) del : remove the given object from the scene ls : list all the objects of the scene col : color the given object fill/empty : fill or empty the given object hide/show : hide or show the given object mul : multiply int*int times the last drawn object, mainly for debugging purposes back : load the file as a background image (GIF, JPEG or PNG) save/load : save or load the scene from the given file javi : load a JaviMap scene from the given file state : displays the possible states for an object and its current state state : change the state of the given object is an alphanumeric identifier or could be * for all the objects is a valid file without spaces, the base directory is the Oscar directory (so the file etc/pic.jpg will be the file $OSCAR_HOME/etc/pic.jpg) is either { black, blue, cyan, darkGray, gray, green, lightGray, magenta, orange, pink, red, white, yellow } or (like "0,123,255,180") 3.4.1.1.2 Creating a scene with JaviMap It is advised (but not necessary) to use JaviMap to facilitate the scene building, see http://www4.vc-net.ne.jp/~klivo/mapo/javimap.htm (Cleve Lendon) In JaviMap : create an image map from a picture P and save it in JaviMap format. In GestureCapture : Amigo IST-2004-004182 89/114
January 2008 Public • load the JaviMap file using command "javi " • load the background image P with "back " • save the scene (map+background) using "save " • edit the scene to add the objType or other features of the objects 3.4.1.1.3 Complete tutorial (with Oscar) 0- achieve the needed requirements, run the OSGI framework (it is normally loaded when you start Oscar) and the required AMIGO services (see the Requirements in the Deployment part) 1- compile each service (gesturecapture, gestureinterpreter, sceneconfigurator) with "ant", and copy the jar files located in the dist directories of each service, to the $OSCAR_HOME/bundle directory. 2- run the services (in this order) : start file:bundle/gesture-capture.jar start file:bundle/gesture-interpreter.jar start file:bundle/scene-configurator.jar Normally the gesture capture frame and the configuration frame should appear. 3- configure them by first copying the GestureCapture etc directory containing sample scenes into the $OSCAR_HOME directory. Then push the button “configure” and choose a scene you just copied. You can change the location of the scene files providing that the url they contain remain valid (in the sample scenes they are relative to $OSCAR_HOME directory). Normally the scene should appear in the gesture capture frame. 4- test some commands. For example type « show * » to show all the objects, type « ls » to list the objects, ...etc. 5- select objects with a mouse or a tactile pen. You can target, point or circle the objects. Check the Oscar windows, you should see that the interpreter sent a GestureSelection event containing all the selected objects associated to salience measures. This GestureSelection event is intended to be consumed by the MultiModalFusion agent, but any module can use it also. 6- now you can use the FillerDemo developed for the AMIGO november 2006 review. This service shows a possible use of the output of the GestureInterpreter : it does nothing else than highlighting for few seconds the selected objects according to the saliences found in the GestureSelection event. Compile the filler-demo service with "ant", copy the jar file in the dist directory to the $OSCAR_HOME/bundle directory, then run the service : start file:bundle/filler-demo.jar 7- then load the appartment scene and selects the objects. You should see that the objects are more or less activated according to your gesture. Note that if you try loading the man Amigo IST-2004-004182 90/114
Page 1 and 2:
IST Amigo Project Deliverable D4.7
Page 3 and 4:
January 2008 Public Table of Conten
Page 5 and 6:
January 2008 Public 3.2.3.4 Configu
Page 7 and 8:
January 2008 Public 1 Speech based
Page 9 and 10:
January 2008 Public Bugs - Patches
Page 11 and 12:
January 2008 Public 1.2 Deployment
Page 13 and 14:
January 2008 Public SWIsvcMonPort=
Page 15 and 16:
January 2008 Public # RealSpeak por
Page 17 and 18:
January 2008 Public 6666 20 10
Page 19 and 20:
January 2008 Public true C:/Temp/
Page 21 and 22:
January 2008 Public [Recording_TCP]
Page 23 and 24:
January 2008 Public Example string
Page 25 and 26:
January 2008 Public 1.3.2 Explicit
Page 27 and 28:
January 2008 Public • the user sp
Page 29 and 30:
January 2008 Public parameters. The
Page 31 and 32:
January 2008 Public In this example
Page 33 and 34:
January 2008 Public Assuming that y
Page 35 and 36:
January 2008 Public Step 3 Rebuild
Page 37 and 38:
January 2008 Public 1.4.1.3 Run Tra
Page 39 and 40: January 2008 Public On a successful
Page 41: January 2008 Public At the end the
Page 44 and 45: January 2008 Public At the end the
Page 46 and 47: January 2008 Public Step 5 In the S
Page 48 and 49: January 2008 Public Step 8 In Serve
Page 50 and 51: January 2008 Public 1.4.2.5 Run Voi
Page 52 and 53: January 2008 Public 1.4.2.6 Run Voi
Page 54 and 55: January 2008 Public As soon as the
Page 56 and 57: January 2008 Public • SoapBox bas
Page 58 and 59: January 2008 Public 2.2.1.1.4 Confi
Page 60 and 61: January 2008 Public The gesture ser
Page 62 and 63: January 2008 Public • Folder Volu
Page 64 and 65: January 2008 Public After installat
Page 66 and 67: January 2008 Public Up 65 In
Page 68 and 69: January 2008 Public Figure below pr
Page 70 and 71: January 2008 Public Development sta
Page 72 and 73: January 2008 Public Tools Oscar Fil
Page 74 and 75: January 2008 Public Bugs None Patch
Page 76 and 77: January 2008 Public 3.2 Deployment
Page 78 and 79: January 2008 Public Scene descripti
Page 80 and 81: January 2008 Public 3.2.2.5 Comp
Page 82 and 83: January 2008 Public 3.3 Component A
Page 84 and 85: January 2008 Public 3.3.3 Multimoda
Page 86 and 87: January 2008 Public Fallback soluti
Page 88 and 89: January 2008 Public 3.3.3.4 Compone
Page 92 and 93: January 2008 Public scene, the imag
Page 94 and 95: January 2008 Public objectDesc VCR
Page 96 and 97: January 2008 Public 3.5 Assessment
Page 98 and 99: January 2008 Public 3.6 Appendix 3.
Page 100 and 101: January 2008 Public Intended audien
Page 102 and 103: January 2008 Public 3.9 Component A
Page 104 and 105: January 2008 Public interface input
Page 106 and 107: January 2008 Public Figure 7 Classe
Page 108 and 109: January 2008 Public different sub-m
Page 110 and 111: January 2008 Public Figure 3: Menu
Page 112 and 113: January 2008 Public 30% 10% 7% 0% 5
Page 114 and 115: January 2008 Public Figure 10: Conc
show all

User Interface Service Software Developerís Guide - Hitech Projects

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?