TSI report for the period 2005-2009 - Département Traitement du ...

11.2. Main Results 11. Multimedia (MM)
with F. Tupin et L. Denis ENSML). A new grant on this subject (funded by DGA/REI) has been
accepted and should start soon (in collaboration with J-F, Aujol (CMLA) and J-M. Nicolas). M.
Sigelle has also been working in collaboration with W. Pieczinsky (Télécom SudParis), F. Tupin
and D. Benboudjema on triplet Markov Random Fields AIMED TO texture analysis and indexing
in the framework of the Info@Magic project.
M. Sigelle started a collaboration with I. Jermyn (INRIA ARIANA) and S. Perreau (UNISA
Adelaide Australia) on the topics of (discrete) diffusion processes, which can be applied both to
modelling of traffic routing in ad hoc networks and to image restoration [2194, 2360].
The studies of C. Faure on documents and images emphasized the role of communication and
the visual modality. Digital and digitised documents are processed to facilitate information access.
Layout and logical structures are automaticaly detected in document images or in semi-structured
digital documents. Applications were developped for the RNTL project InfRadio for which web
documents were adapted to be read and activated on the small screens of mobile devices [2224].
More recently, document image analysis was performed for the digital library medic@ to assist
the archivists in indexing and storing historical medical documents. New methods were proposed
to structure the images of the pages and to extract relevant components such as the figure and
caption pairs [2096, 2094, 2095]. To cope with ancient fonts difficult to recognise by OCR, word
spotting methods were proposed to search for word-images similar to query words [2231, 2128,
2129]. These works for medic@ are made in collaboration with the LIPADE (Univ. Paris V). In
GEOservice, a joint project between several research teams of the Institut Télécom (C. Faure
was prime), the visual modality was involved in a web service. Images were combined with text
to provide multimodal egocentric instructions for guiding a mobile user in a building. As a natural
complement of the visual modality, the gestural modality was studied in the context of humancomputer
interaction where the users drew or wrote to communicate [2093, 2223, 2260, 2234,
2086].
11.2.4 Audio-visual Identity/Imposture and Virtual Worlds
Faculty G. Chollet, C. Pelachaud, M. Sigelle, M. Charbit
Main events G. Chollet and C. Pelachaud, general co-chairs of IVA’07; C. Pelachaud and T.
Boubekeur, co-editor special issue on Facial Modeling, IEEE Computer Graphics and Applications,
to appear in 2010; C. Pelachaud co-organizer of a Workshop held in conjunction
with AAMAS 2009; she is since 2007 secretary of the Humaine association on emotion;
she is part of the selection committee of ANR CONTINT (since 2008), ANR Blanc CSD9
Sciences Humaines et sociales (in 2009).
Projects IST NoE BIOSECURE (2004-2007), IV2 TechnoVision (2006-2007), IST SECURE-
PHONE (2005-2007), IST NoE KSpace (2005-2008), INFOM@GIC (Cap Digital) (2006-
2009), ANR KIVAOU (2008-2010), ANR MYBlog3D (2006-2010), CompanionAble: IP de
IST (2008-2012), ANR blanc OUISPER (2006-2009), IST IP-CALLAS (2006-2010), IST
STREP-SEMAINE (2008-2011), IST NoE-SSPNet (2009-2013), COST Action 2102 (2006-
2010), ANR CECIL (2009-2011), ANR GV-Lex (2009-2011), ANR IMMEMO (2009-2011)
Two main directions of investigation are present in this theme:
Biometry and Speech/Face Synthesis/Recognition/Verification
The speech group was created in 1983 when Gérard Chollet joigned Télécom-ParisTech (called
ENST at the time). The focus was centered on coding, synthesis and recognition. In the 1990,
speaker verification was added, followed by language identification five years ago. At that time,
audio-visual speech and speaker recognition became a topic of interest. The Biosecure network
of excellence was an opportunity to promote open-source software for major biometric modalities
(face, voice, audio-visual speaker, signature, iris, hand shape...) This led to the publication of
206