Stereoscopic 3D UIs on Snapdragon- based Android Devices - Uplinq

uplinq.com

Stereoscopic 3D UIs on Snapdragon- based Android Devices - Uplinq

ong>Stereoscopicong> ong>3Dong> ong>UIsong> on Snapdragonbased

Android Devices

Ville-Veikko Helppi

Director of Marketing, Rightware


Future of Song>3Dong> User Interfaces

Mobile

Consumer

Home

entertainment

Automotive

Tablets,

ong>3Dong> TVs,

Set‐Top‐Boxes,

Cameras,

Camcorders

Smartphones are driving the Song>3Dong>

revolution in embedded devices

Explosive growth in Song>3Dong>

technologies across

embedded markets

Song>3Dong> display market will

hit $22B by 2018: 38%

CAGR in revenue and

75% CAGR in units

Displaysearch 2010


Android

Hot Today, Hot Tomorrow


Android in Numbers

• Nearly 100M Android handsets sold &

activated already in 2011

• 400,000 new handsets are sold everyday

• Over 200,000 apps available in Android

App Market

• Over 4,5 billion apps have been

downloaded from the App Market

• 310 different Android handsets available in

112 different countries

Source: Google 5/2011


Android Facts and Forecasts

• Growth from 2009->2010

– 6,7M -> 67,2M (888%)

– 3,9% -> 22,7% (market share)

• Strong growth forecasted

for the following years

• In Q1’11, Android is the no.1

platform in smartphones

Android beyond mobile (e.g.

automotive, consumer)

Source: Gartner 2/2011 & 4/2011

350 120

300

100

250

80

200

60

150

40

100

20

50

0

0

Smart platforms Volume used 2010

2008 2009 2010 2011

(est.)

2012

(est.)


More Android Forecasts

Android will become

the biggest mobile

content platform by

August 2011

• Number of apps in

May 2011

– Apple: 381,062

• April’10: 11,000

Android: 294,738

• April’10: 28,000

Android takes

over Apple at

425,000

Source: research2guidance 5/2011


Android beyond Mobile

Consumer

Home

entertainment

Transportation

Medical

Office

automation

Tablets

eReaders

MID

STBs & TVs

Digital Photo

Frame

In‐Vehicle

Infotainment

Passanger

Infotainment

Diagnosis devices

Printers

Scanners

IPTVs

PMP

Cameras

Home

Automation

devices

Navigation

Alarm /

notification

devices

Multi‐purpose

devices


Android Tech Point of View

• Integrated software

platform for building

connected devices

Differentiation, More Features

Consistency

• Open Source but not GPL

• Complete software stack

on Feature top of set, Linux Adaptability

• Promotes software reuse

and consistency

Stability

• Compatibility & access


Android and CTS

• Compatibility Test Suite

• Compatibility Definition Document

• Automated testing harness

– CTS test harness on PC

– Individual test cases

• What CTS tests do

– Signatures, Platform API, DVM,

Platform Data Model, Core platform

libraries & permissions & resources


Android Challenges

• Differentiation

– The same platform and UI for everyone?

– Plenty of Apps – what happens to usability?

– How to leverage the legacy?

• Efficient use of hardware

– How to get the best out of silicon?

– The support for Song>3Dong> technologies?

• Lack of comprehensive UI development tools


ong>Stereoscopicong> ong>3Dong>

The Differentiator, Now and in the Future


Song>3Dong> Forecast

• 2010:

– 0,7M units

– $902M revenues

• 2018:

– 195M units

– $22B revenues

• CAGR: 38% ($)

• CAGR: 75% (units)

Source: Displaysearch 2010

• Form factor through mobile devices

• Consumer devices such as DTVs, e-

books, media players, digital

cameras, camcorders, photo frames


Some Song>3Dong> Definitions

ong>3Dong> viewing technology

• Active

– Shutter glasses

• Passive

– Polarized glasses

– Color anaglyfic glasses

• Autostereoscopic

– Parallax barrier

– Lenticular lens


Why Song>3Dong>?

• Realistic ong>3Dong> User Experiences

– Better perception of depth factor

– Naturally occuring phenomenas

– Detailed level of immersion

– Gestures with multi-touch

– Physics and Haptics

• Better use of resources

– Reduce need for disk space & memory

– Easier to build and modify


Factors and Drivers for Song>3Dong>

• Key factors for adoption

–Price

– No-Glasses

– Content

– Consumer education

• What also drives Song>3Dong> demand

– User-generated ong>3Dong> content (dual-lensed cameras)

– Playback & Execution of ong>3Dong> content

ong>3Dong> gaming, applications and widgets


Key Pain Points – Traditional UI Building

• Radical differentiation and usability

optimization demand s/w changes

• Big screens demand graphics h/w

• Changes to s/w are expensive,

risky, and need to be minimized

• Pressure to standardize and re-use

• OS switching costs are high

• A ‘standard’ OS may reduce risk

but can lead to ‘me too’ products

• Cost pressure demands low BOM

ong>3Dong> graphics h/w is becoming cost

effective but is hard to develop for

User Interface

Look and Feel

(home screen, app, widget..)

Applications, Middleware,

Additional Application frameworks, Software

User Interface Layers

Android System Software

Target Snapdragon Hardware


Key to Success: Song>3Dong> + UI Abstraction

• ’Codeless’ approach – no coding required to

design, create, test and deploy user interface

• Abstract all possible details – rely only on

OpenGL ES and other standard UI frameworks

• Use variety of industry standards – ong>3Dong>

content creation tools to create Song>3Dong> content

• Decrease costs & development risks – use

UI technology that enables separation of

engineer’s and designer’s tasks


Kanzi UI Solution

The Song>3Dong> Revolution Begins Today


Kanzi UI Solution for Song>3Dong>

• UI Development Time to a Fraction

Rapid creation and radical customization of ong>3Dong> ong>UIsong>

without coding, scripting or generating the code

• Unique Device Differentiation

Innovative, highly differentiated ong>3Dong> UI effects,

animations, transitions, materials, lightings,

cameras

• Fastest Performance for UI

Rightware’s leader position in device performance

measurement & optimization concretes in Kanzi

• Compelling ong>3Dong> UI Design Toolkit

Enabling creation, customization, and testing of ong>UIsong>

separates the designers & engineers tasks

• Support for Industry Standards

Flash compatibility in ong>3Dong> ong>UIsong>, Built on top of

OpenGL ES and COLLADA, HW and OS agnostic

UI framework


Kanzi Product

Kanzi UI Solution

Seamless, immediate

deployment of Song>3Dong> user

interfaces

PC/Host

• Editor for creation and testing of

Song>3Dong> content without coding

• Different Song>3Dong> modes with rich

effects adjustable in realtime

• Accelerates the UI development

Snapdragon-based

target device

• Written in C

• Highly optimized (>60 fps)

• Out-of-the-box support for

Song>3Dong> rendering

• Fully Android compatible


Kanzi Workflow – UI from scratch to MDP

ong>3Dong> Modeling Tools

Use industry’s standard

design tools to create

ong>3Dong> objects, visual effects

and animations

Embedded Platform

Use the standard

embedded OS

or platform –

No need to

write any code

when deploying UI

Graphics Image

Editors

Design and create textures,

images, graphical content

using the standard tools

.kzb

Ported

OS

Flash

Develop Flash animations

and other Flash-content

Using standard tools


Kanzi Studio

Property

Editor

Project

Explorer

Application

Window with realtime

preview

Tool Box

Graph

Editor


Kanzi Engine

• Performance. Highly optimized engine

gives 60+ fps even with complex & highly

sophisticated user interfaces.

• Efficient use of silicon. Maximizes the

use of GPU, and leaves CPU use for

applications and other software.

• Scalability. Based on OpenGL ES gives

flexibility to scale UI designs to whole

new devices having Snapdragon.

• Riskless development & deployment.

Kanzi binary (.kzb) ensures that nothing

goes wrong in execution of UI content.

.kzb .kzb .kzb

Kanzi Engine

OpenGL ES

Platform / OS

Drivers


Step #1 to build Song>3Dong> User Interface

User creates graphical content

and interaction logic for the user

interface or home screen.


Step #2 to build Song>3Dong> User Interface

User adds a stereoscopic

composer. Render passes under

composer use Song>3Dong> composition.


Step #3 to build Song>3Dong> User Interface

Standard

Song>3Dong> modes:

- VerticalLineInterlaced

- TopBottom

- LeftRight

- RightLeft

- AnaglyphicRedCyan

... and all

customizable!

User selects Song>3Dong> mode.


Step #4 to build Song>3Dong> User Interface

Tune Properties; Render Passes

or Camera Specific ones.


Step #5 to build Song>3Dong> User Interface

Song>3Dong> View is calculated from

single Camera using Song>3Dong>

properties.


How Kanzi forms Song>3Dong> effect

Left eye

information

Song>3Dong> camera settings

can be configured in

realtime.

Song>3Dong> content depth

can be configured in

realtime.

Left and Right

eye views are

composed.

Right eye

information

ong>Stereoscopicong> ong>3Dong>

mode can be

switched in

realtime.

Kanzi Studio

offers true Song>3Dong>

WYSIWYG editor

to the UI

developers.


Demonstration

Spectrum Plus


Spectrum Plus – Introduction

• Native Android homescreen replaced with

Song>3Dong> UI running on Snapdragon

ong>3Dong> content rendered in stereoscopic mode

(dynamic lighting and reflections)

Android content and data is used as textures

on ong>3Dong> surfaces

• Real-time particle system on Snapdragon

• Depth & Song>3Dong> Effects adjustable in realtime


Conclusion / Q&A


Conclusion

• Snapdragon + Kanzi =

Fantastic performance for

Song>3Dong> ong>UIsong>, available today

• Combination of the best:

Song>3Dong> Tools, Software and

Silicon

• Rich User Experiences

with stereoscopic content


THANK YOU!

ville-veikko.helppi@rightware.com

More magazines by this user
Similar magazines