<strong>IEEE</strong> COMSOC MMTC E-LetterIn 1996 he joint the Heinrich-Hertz-Institute(HHI) Berlin, Image Processing Department,where he is working on projects focused onmotion and disparity estimation, incomplete 3Dsurface representation and coding, combined 2Dand 3D object description, viewpoint synthesisand 3D scene reconstruction.He has been actively involved in MPEGactivities, standardizing the multi-viewdescription for MPEG-7 and view-dependentmulti-texturing methods and dynamic meshcompression for the 3D scene representation inMPEG-4 AFX (Animation FrameworkeXtension). He contributed to the multi-viewcoding in MPEG-4 MVC (Multi-View VideoCoding) and co-chairs the MPEG 3D Videoactivities.In recent projects he was involved in researchand development of traffic surveillance systemsand visualization of multiple-view video, objectsegmentation and tracking and interactive usernavigation in 3D environments. Currently, he isa Project Manager for European projects in thefield of 3D video technology and multimediacontent description.He is Senior Member of the <strong>IEEE</strong> (M’98-SM’07).http://www.comsoc.org/~mmc/ 24/41 Vol.4, No.7, August 2009
<strong>IEEE</strong> COMSOC MMTC E-LetterInteractive 3D Online ApplicationsIrene Cheng, University of Alberta, Canadalin@cs.ualberta.caAbstractInteractive 3D content has become an integralpart in online applications. Examples can befound in Second Life, Google 3D City scene andMicrosoft 3D reconstruction using multiple 2Dphotos. One advantage attributable to 3D contentis the extra dimension, which provides bettervisual communication than 2D to representstructures and explain concepts. Moreimportantly, human computer interaction makesthe user feel engaged and in control, and thusobtain higher satisfaction. The increasingpopularity of Blackberry, iPhone and cell-phonesmakes us constantly anticipate what main streaminteractive 3D online applications will beavailable next on mobile devices. Thesepromises also lead us to think what newstrategies should be employed to overcomeobstacles such as competing bandwidth, signalinterference and limited processing power onmobile devices. Despite the advancements in thelast two decades, providing interactive 3D onlinecontent in high quality without jeopardizinginteractivity is still a challenge. This articlereviews current and potential trend, the issuesinvolved, as well as the compression andtransmission strategies designed to address thesechallenges.Keywords: Interactive 3D, VisualCommunication, Online Applications, 3Dcompression and transmission, Level-of-detail,Perceptual Quality1. IntroductionSpontaneous system response and high qualitydisplay are two main user expectations frominteractive 3D online applications. In the olddays, due to slow rendering, insufficientbandwidth and low processing power, usinginteractive 3D content was not possible in onlineapplications. In order to support fast real timerendering, display quality had been compromised,where coarse 3D models mapped with lowquality texture were used. With the advancementin technology, the qualities of 3D graphics andanimations have improved significantly in thelast ten years, particularly in the onlineentertainment industry. 3D content providesvibrant and realistic sensation, which is moreappealing than still images. Augmented realityincorporating 3D objects in video streamsenhances human perception by strengthening thedepth perspective. Virtual 3D scene presented ina panoramic setting brings the viewers to atotally immersive environment. Moreover, theemerging 3D television and display (3DTV)technology has changed the landscape relating tohow digital content is delivered, presented andappreciated by human observers. While some3DTV technology still uses eye-wear to simulateimmersion, more advanced stereoscopic displayshave been launched providing multiple and freeviewpoint entertainment without using eye-wear.This trend will have great impact on homeentertainment.Visual communication no doubt has evolvedfrom the traditional 2D media to a 3D virtualworld and beyond. Although there is a generalacceptance of interactive 3D content and, to acertain extent, an addiction to online games, thecapacities and benefits of interactive 3Dtechnology are still not fully explored as theyshould have been. The goal of this article is toinspire thoughts to develop more effectivesystems and robust algorithms to supportinteractive 3D online applications.The rest of this paper is organized as follows;Section 2 reviews some interactive 3D onlineapplications; Section 3 looks at some 3Dcompression and transmission strategies; Section4 highlights the emerging development in 3DTV;and Section 5 gives the summary.2. Evolution of Visual Communicationtowards Interactive 3D2.1 Interactive 3D Online Learning, Testingand AuthoringOnline education, which includes K-12,university degrees and diplomas, has been usedto complement classroom teaching. Other thanmaking education more accessible, the adaptionof interactive 3D content in online educationaims to provide more semantically and visuallyappealing information that cannot be provided byusing traditional media. For example, instead ofusing text and image in a multiple choice formatto ask a question, interactive 3D can beembedded in Math and Chemistry questions –http://www.comsoc.org/~mmc/ 25/41 Vol.4, No.7, August 2009