input
input
input
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Web<br />
MMI MMI <br />
MMI
Issues on Interaction with Web<br />
The coming of heterogeneous devices<br />
and interaction manner<br />
• access by :<br />
PC, Mobile phone, PDA, AutoPC, DTV, …<br />
• interaction with:<br />
modality-rich terminals, mixed initiative, ...
Our Purpose:<br />
Seamless Services over Internet<br />
XML Document Server<br />
(Contents ; View ; Interaction)<br />
Ex. On-line Shopping<br />
Devices<br />
- order goods at Kiosk ..... touch panel<br />
- confirm the order with a mobile phone ..... voice<br />
- change the order at home ..... DTV remote terminal
How to do it?<br />
XML Document Server<br />
(Contents ; View ; Interaction)<br />
XISL: Extensible Interaction-Sheet Language<br />
remodels VoiceXML to meet MMI requirements<br />
<br />
VoiceXML<br />
........<br />
XISL: Device-Independent - 1/3<br />
no modality-specific tag : <strong>input</strong> modality<br />
<br />
data<br />
<br />
<br />
digit<br />
<br />
...........
XISL: Device-Independent - 2/3<br />
Keyboard<br />
Front-end Module<br />
Dialog<br />
Manager<br />
Hello!<br />
Pointing<br />
Hello<br />
ASR<br />
grammar<br />
word1: Hello<br />
type: speech<br />
event:recognize<br />
recognize grammar rule:<br />
introduction<br />
return: word1<br />
type: pointing<br />
:<br />
<br />
type: speech<br />
event: recognize<br />
target: ***.xml<br />
match: /page<br />
return:<br />
word1:Hello<br />
XISL: Device-Independent - 3/3<br />
no modality-specific tag : output modality<br />
type event mode<br />
window open, close, …<br />
speech play, stop, … TTS, rec_speech, …<br />
video play, stop, …<br />
audio play, stop, …<br />
agent move, speak, …
MMI Description Language: XISL<br />
- is content ( & view ) -independent.<br />
- has no modality-specific tags<br />
that enable XISL device-independent.<br />
- has MMI control tags and attributes.<br />
• realizes seamless services over internet<br />
and reuse of XML documents.<br />
• meets modality-rich services<br />
and avoids patent issues.
XISL enables combinatorial usage of modalities.<br />
← adding a new modality<br />
Sequential<br />
Alternative<br />
Parallel
<br />
<br />
.........<br />
<br />
<br />
<br />
<br />
<br />
digit<br />
<br />
<br />
data<br />
<br />
< /operation ><br />
XISL: example -1/2
XISL: example -2/2<br />
< action comb = “seq” ><br />
<br />
nancy<br />
<br />
You selected No. One.<br />
< /output ><br />
< call dialogue_name=“2”/ ><br />
< /action >
MMI
• Web<br />
• <br />
<br />
<br />
XISL<br />
XML<br />
<br />
XSL
XISL<br />
• XML<br />
• <br />
•
XISL<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
XML<br />
<br />
<br />
<br />
XISL<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
<br />
XISL<br />
• <br />
- CGI<br />
• <br />
- <br />
• ECMAScript<br />
http://www.vox.tutkie.tut.ac.jp/XISL/XISL.html
• <br />
• <br />
XISL<br />
• XISL<br />
<br />
<br />
XML<br />
<br />
<br />
<br />
GLR<br />
<br />
<br />
<br />
<br />
XISL
• <br />
<br />
GLR<br />
– <br />
– <br />
– <br />
<br />
–
Implementation -3/4<br />
Dialogue Control by Using GLR TBL<br />
IN<br />
State<br />
buy_btn<br />
SHIFT-3<br />
<br />
<br />
<br />
ACTION TBL<br />
goods_sp timeout<br />
SHIFT-4<br />
SHIFT-5<br />
complete<br />
ACCEPT<br />
GOTO TBL<br />
EXCH1<br />
SHIFT-1 SHIFT-2<br />
BUYGOODS<br />
<br />
<br />
REDUCE-<br />
REDUCE-2<br />
2<br />
REDUCE-1
• <br />
• <br />
• <br />
•
PC<br />
• <br />
…<br />
• <br />
<br />
• <br />
•
PC<br />
• MMI<br />
XML<br />
• Web<br />
HTML<br />
• <br />
• <br />
TTS)<br />
• TTS<br />
•
• <br />
OLS<br />
– <br />
– <br />
– <br />
–
Implementation -4/4
Interaction Builder<br />
• <br />
– <br />
– <br />
–
Interaction Builder<br />
• <br />
– <br />
– <br />
–
- 2/6
- 3/6
- 4/6<br />
<br />
“
Future Work<br />
- XHTML + XISL ; DOM2, XForms, XMLevent,<br />
SMIL..<br />
- Implementation of 3GPP applications<br />
- MMI Requirements:<br />
more complicated usage of MMI<br />
- Rapid-prototyping:<br />
GUI-based developer support system (IPA project)<br />
http://www.vox.tutkie.tut.ac.jp/XISL/XISL-E.html
Change language