Stereoscopic-SD-Video-Imaging-Support-Snapdragon (pdf) - Uplinq

uplinq.com

Stereoscopic-SD-Video-Imaging-Support-Snapdragon (pdf) - Uplinq

Stereoscopic 3D Video and ImagingPresented by Tim Yates and Paul Torres


Stereoscopic 3D Worldwide ForecastWhy developers and OEMs should be interested in stereoscopic 3D support• Exponential growth in S3Dprojected into the future• Growth being driven by35,000,00030,000,00029,323,160– Availability—3D TVs and 3Dcontent are becoming morepervasive– Awareness—3D movies and theavailability of 3D TVs and 3Dcameras / video recorders areincreasing in overall adoption– Appeal—improvement in 3Dquality is increasing consumerdemandUnits25,000,00020,000,00015,000,00010,000,0005,000,000013,083,2405,492,270100,000846,2442010 2011 2012 2013 2014TabletsSmartphonesSource: In-Stat, 11/20102


Qualcomm Stereoscopic 3D Technology• Stereoscopic 3D high definition video andphoto capture– Calibration and synchronization of left/right imaging sensorswith Module Partner– 1080p side-by-side video encoded with H.264hardware encoder– JPEG-S or MPO (CIPA) file format for 3D Photos• Stereoscopic 3D high definitionvideo playback– 1080p side-by-side video decoded with H.264hardware decoder– 3D info-frame for automatic switching display to 3D mode– HDMI output• Real-time 2D to 3D high definitionvideo conversion– Depth map estimation from chroma information– Second view synthesis using depth map– HDMI output3


Stereoscopic 3D Support with MSM8x60• MSM8x60: perfect combination of high performance accelerators to enable 3Dcapture and playback– Linking H/W ISP, H/W Video, 2D GPU, 3D GPU, Dual Core CPU for an end-end 3D capture and displaysolution– Available since GingerbreadStereo Videoand SnapshotLSynch& CALRMSM8x60SEIMVC3D TV @ 1080P3D Module Partner Program• QCOM full mechanical reference andcalibration design• Cost effective FOXCONN and LITEON modules• 5MPixel-8MPixel 720P / 1080p video support• Full driver and tuningsJPEG-SMPOMSM8x60 Android Stereo 3D FeaturesPanel: WXGA2D or 3D• 3D Photo: 5M-8Mpixel Stereo, 3D AE & AWB, JPEG-Stereo / MPO• 3D Video: H.264 1080p 30fps stereo / viewfinder• Geometry Alignment: Z180• 3D Processing: SnapDragon• 3D Display: WXGA LCD / TV viewfinder• 3D TV: via HDMI (1920 x 1080p)4


Stereoscopic 3D Imaging and Video Capture• Stereoscopic 3D imaging and video capture– Calibration and synchronization of left/right imaging sensors– Geometry correction, digital zoom and 3A optimized for 3D video– Convergence control based on scene analysis and display– 2D viewfinder with 3D quality indicator– 1080p side-by-side video encoded with H.264 hardware encoder– JPEG-S or MPO stereo JPEG file format– Available February 2011Camera CalibrationParametersUsage Mode ParametersZoom/Pan parametersDisplay GeometryFine GeometryCompensationKey PointDetectionKey PointMatching3D ConvergenceControl3D ConvergenceAdjustmentImage Crop &Border CorrectionSmart 2DBased on “state”Other ConvergenceControl5


Stereoscopic 3D Video Playback andDisplay Technology• Stereoscopic 3D high definitionvideo playback– 1080p side-by-side (SEI) or MVC video decoded withH.264 hardware decoder– 3D infoframe for automatic switching display to 3D mode– HDMI output– Available February 2011• Auto stereoscopic displays– Parallax barrier• Most popular technology for S3D displays• Switchable to allow display to run in 2D or 3D mode• Switchable to allow display to run in portrait or landscapemode for 3D– Lenticular• Not as widely supported as parallax barrier• Implementations to date are not switchable, display ispermanently in 3D mode– Frame sequential• Similar to 3D TV display technology• Thinner display stack at the cost of power• Requires host processor to run at 120Hz6


2D to Stereoscopic 3D Conversion• Real-time 2D to 3D highdefinition video conversion– Depth map estimation fromchroma information– Second view synthesis usingdepth map– Frame packing arrangementfor desired 3D videopresentation format– HDMI output– Available July 2011• Applicable to– Still Images– Video– Graphics (Games)2D Videoleft viewDepthEstimationEstimatedDepth forSynthesisViewSynthesisSynthesizedright view7


2D to Stereoscopic 3D Conversion• Real-time 2D to 3D highdefinition video conversion– Depth map estimation fromchroma information– Second view synthesis usingdepth map– Frame packing arrangementfor desired 3D videopresentation format– HDMI output– Available July 2011• Applicable to– Still Images– Video– Graphics (Games)2D Videoleft viewDepth Map ImageLeft ViewDepthEstimationEstimatedDepth forSynthesisSynthesized ImageSynthesized Right ViewViewSynthesisSynthesizedright view8


Qualcomm Delivers Complete Stereoscopic3D SolutionStereo Imaging ModuleVideo andImaging Codecs3D Video/Image Preand Post Processing3D Display Support3D Media PlaceShift and Share2D to 3D Conversion• Turn-key, cost-effective 3D imaging sensor module• Mechanical specification, tolerances, schematics• 3D quality assurance and calibration• 3D AE, AWB, drivers, color tuning and compensation for L & R imager• H.264 for 1080p30 stereo video• H.264 SEI side-by-side and MVC codec support• JPEG-S and MPO (Multi-view format) for 3D• 3D camera geometry alignment• 3D viewfinder• 3D “quality meter”• 3D zooming• 3D post processing and scaling• 3D auto stereo panels• 3D TV via HDMI• Get the 3D clips off the phone and onto the home entertainment system!• Skifta / DLNA• ARM based real time conversion of 720p30 video• Less than %50 CPU utilization through Neon acceleration9


Thank you!Qualcomm is a registered trademark and registered service mark of Qualcomm Incorporated. Other products and brand names may be trademarksor registered trademarks of their respective owners.Product descriptions contained herein are subject to change from time to time without notice.© 2011 QUALCOMM Incorporated. All rights reserved.QUALCOMM Incorporated, 5775 Morehouse Drive, San Diego, CA 92121-1714

More magazines by this user
Similar magazines