Memoria-Mea

MEMORIA–MEA: SEMANTIC TECHNOLOGIES &INTERACTIVE VISUALIZATION TECHNIQUES FOR P.I.M.Francesco Carrino, Maria Sokhn, Elena Mugellini, Omar Abou KhaledMultimedia Information System Group (MISG)University of applied Sciences of Fribourg, Switzerland

OUTLINE2 Introduction Context & Issues Proposal Memoria-Mea Architecture Prototype Conclusion & Future WorkFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

3INTRODUCTIONFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

INTRODUCTION5 Primary idea of the talk Present the MemoriaMea Framework, a PersonalInformation Management (PIM) system developed to (1)manage multimedia content, (2) support the user insearching, browsing and visualizing “multimediamemories”.Francesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

6CONTEXT & ISSUESFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

CONTEXT & ISSUES7 Context: Thanks to the development of newtechnologies and with the advent of the Web,people are faced to deal with an increasing amountof information during their every day-life activitiesPersonal InformationFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

CONTEXT & ISSUES8 Problem: finding the right information, at the righttime, in a short period of timeFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

CONTEXT & ISSUES9 Technological solutions: semantic web data mining interactive visualizations What do we miss?INTEGRATION!!!Francesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

10PROPOSALFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL11 Memoria-Mea: main ideas Personal Information Management (PIM) system formanaging multimedia content Support the user in searching, browsing and visualizing“multimedia memories” Based on personalized information indexing andclassification (ontology-based annotations andreasoning along with data mining techniques)Francesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL12 Memoria-Mea: Logical ArchitectureFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

13MemoSIVMemoSAMProtégéFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL14 Memoria-Mea: Technical ArchitectureVisualizationModuleVirtual Queries ModuleAnnotationModuleData Mining ModuleQueriesAnalysisModuleExpansionQueriesModuleTermsRecommendationRulesExtractionModuleVQ OntoVQ ClassicalIndexOntoEngineClassicalIndexesaccessible via WebGDSIndexPCPersonal DataFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

15Visualization ModuleAnnotation ModuleVirtual Queries ModuleData Mining ModuleQueriesAnalysisModuleExpansionQueriesModuleTermsRecommendationRulesExtractionModuleVQ OntoVQ ClassicalIndexOntoEngineClassicalIndexesaccessible via WebGDSIndexPCPersonalDataFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL: Prototype16 MemoSIV: Memoria-Mea Smart InformationVisualization Search & browse Heterogeneous collection of multimedia content• Pictures• Videos• Audio files• Text Documents Two main navigation metaphors• Browse data according to their type• Browse data according to events (chronologically ordered)Francesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL: Prototype17 MemoSIV – Main InterfaceFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL: Prototype18Francesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

PROPOSAL: Prototype19 MemoSAM: Memoria-Mea Semantic Annotation ofMultimedia Semantic knowledge based engine: store & reason aboutsemantic data, infer new knowledge, accessible through webservices• Jena framework Handle Ontologies• Jetty Web Server• Pellet Reasoner• MemoOnto (own ontology) + Other public ontologies andknowledge bases (FOAF, GeoNames, etc) Give access to semantic data to other Memoria-MeamodulesFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

CONCLUSION & FUTURE WORK21 Conclusion This paper presented the Memoria-Meaarchitecture, a novel approach that combinessemantic annotation, semantic knowledge searchengine and interactive visualizations techniques toenrich user experience for searching and browsingthrough personal multimedia data. A prototype that validate the concept has beenpresented.Francesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

CONCLUSION & FUTURE WORK22 Future Work Integration of Virtual Queries Module MemoSIV adaptation to VQ Integration of Annotation Module Evaluation of prototype• Ergonomics &Usability• Willingness to use such technologyFrancesco Carrino – PhD Student – AWIC'1101/02/2011 17:27

Francesco CarrinoFrancesco.Carrino@hefr.ch0041 (0) 26 429 67 45http://francesc.carrino.home.hefr.ch/Memoria-Mea Project: http://www.memoria-mea.ch/23