01.05.2013 Views

Download the .pdf - Metaio

Download the .pdf - Metaio

Download the .pdf - Metaio

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

The Augmented Reality Magazine No. 3 | February 2013<br />

Spotlight on <strong>Metaio</strong> Creator<br />

The Difficulties of being Droid<br />

AR in <strong>the</strong> Construction Industry


2<br />

The Augmented Reality Magazine No. 3 | February 2013<br />

Augmented Reality in Construction<br />

13<br />

LEGO Digital Box<br />

10<br />

4<br />

The <strong>Metaio</strong> AREngine<br />

6<br />

The <strong>Metaio</strong> Creator<br />

14<br />

Enterprise Solutions<br />

12<br />

Android Fragmentation<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

in this issue<br />

forum<br />

The World’s First AR<br />

Processing Unit 3<br />

focus<br />

The <strong>Metaio</strong> AREngine 4<br />

features<br />

The <strong>Metaio</strong> Creator 6<br />

AR in Minutes 7<br />

AR Excitement for 2013 8<br />

Global Mobile Awards 2013 9<br />

AR in Construction 10<br />

Android Fragmentation 12<br />

fragments<br />

LEGO Digital Box 13<br />

<strong>Metaio</strong> Enterprise Solutions 14<br />

events<br />

InsideAR: The Augmented<br />

Reality Conference 15<br />

CeBIT 15<br />

ISMAR 15<br />

insideAR Team<br />

Editor:<br />

Daniel Gelder<br />

Creative Director:<br />

Christopher Zak<br />

Communications Director:<br />

Trak Lord<br />

Copy Editors:<br />

Matthias Greiner<br />

Nikoleta Notova<br />

Design and Layouts:<br />

María Barrena<br />

metaio GmbH<br />

Infanteriestrasse 19, Haus 4B<br />

80797 München, Germany<br />

+49 89 5480 198 0<br />

metaio, Inc.<br />

375 Alabama Street<br />

San Francisco, CA 94110<br />

+1 415 814 3376<br />

www.metaio.com


Press Release<br />

<strong>Metaio</strong> brings world’s first Augmented Reality<br />

Accelerated chipset to market, signs agreement with<br />

ST-Ericsson to integrate future mobile platforms<br />

SAN FRANCISCO – FEBRUARY 21, 2013: <strong>Metaio</strong> today announces an agreement with ST-Ericsson, a leader<br />

in wireless platforms and semiconductors. Under <strong>the</strong> terms of <strong>the</strong> agreement, ST-Ericsson will integrate<br />

<strong>Metaio</strong>’s Augmented Reality hardware IP, <strong>the</strong> so-called “AREngine,” into <strong>the</strong> next generation of ST-Ericsson<br />

mobile platforms resulting in <strong>the</strong> first application processor accelerating Augmented Reality performance<br />

on mobile devices.<br />

<strong>Metaio</strong>’s cutting-edge technology inserts nearly any 3-D and virtual content into <strong>the</strong> real world by recognizing images,<br />

objects and entire environments. In a mobile future that clearly requires smart devices to be ‘always on’ and<br />

connected, <strong>the</strong> <strong>Metaio</strong> AREngine drastically reduces power consumption making all-day AR experiences possible.<br />

This first-of-its-kind collaboration will improve nearly all aspects of an Augmented Reality experience, yielding performance<br />

increases in speed, precision and power consumption, with up to 60 times faster initialization, more than<br />

an AR app running on existing platforms – <strong>the</strong> highest to date in <strong>the</strong> mobile industry. Both <strong>Metaio</strong> and ST-Ericsson<br />

strongly believe that working toge<strong>the</strong>r will accelerate <strong>the</strong> adoption of Augmented Reality as a consumer technology.<br />

“The AREngine will do for Augmented Reality what <strong>the</strong> GPU did years ago for <strong>the</strong> gaming industry,” said <strong>Metaio</strong><br />

CTO Peter Meier. “This is a great leap in <strong>the</strong> AR space, and we strongly believe that <strong>the</strong> AR Engine working with<br />

ST-Ericsson platforms will help realize <strong>the</strong> Augmented City - <strong>the</strong> idea of a completely connected environment<br />

powered by Augmented Reality and made possible with next-gen, optimized mobile platforms.”<br />

“Working toge<strong>the</strong>r, this will be <strong>the</strong> first ever integration of dedicated AR hardware IP on silicon,” said Björn Ekelund,<br />

head of Ecosystem Research and Innovation for ST-Ericsson. “By continuing our relationship with <strong>Metaio</strong>, this<br />

agreement will provide a competitive advantage to both companies and our customers in <strong>the</strong> smartphone and<br />

AR space, where people are looking for differentiating factors when making <strong>the</strong>ir purchase decisions. AR will no<br />

longer be limited to simple 2-D images - with <strong>Metaio</strong>’s AREngine, <strong>the</strong> future possibilities are endless.”<br />

Visitors to <strong>the</strong> 2013 Mobile World Congress in Barcelona will be treated to live demonstrations of <strong>Metaio</strong>’s technology<br />

and <strong>the</strong> benefits of Augmented Reality hardware integration. For more information, visit www.metaio.com/mwc<br />

Watch <strong>the</strong> AREngine video: http://youtu.be/6br7NreTwD4<br />

###<br />

About <strong>Metaio</strong><br />

The worldwide leader in Augmented Reality (AR) research and technology, <strong>Metaio</strong> develops software products<br />

for visually interactive solutions between <strong>the</strong> real and <strong>the</strong> virtual world. Based on <strong>the</strong> <strong>Metaio</strong> Augmented Reality<br />

platform, digital and 3-D content can be integrated seamlessly into <strong>the</strong> user’s camera view looking upon <strong>the</strong> real<br />

world. Powering over 1,000 apps for enterprise, marketing, retail, publishing and industrial cases, over 30 Million<br />

consumers use <strong>Metaio</strong>’s AR software. Learn more at www.metaio.com<br />

About ST-Ericsson<br />

ST-Ericsson is a world leader in developing and delivering a complete portfolio of innovative mobile platforms and<br />

cutting-edge wireless semiconductor solutions across <strong>the</strong> broad spectrum of mobile technologies. ST-Ericsson<br />

was established as a 50/50 joint venture by STMicroelectronics (NYSE:STM) and Ericsson (NASDAQ:ERIC) in<br />

February 2009, with headquarters in Geneva, Switzerland.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

forum The World’s First AR Processing Unit<br />

3


focus The <strong>Metaio</strong> AREngine<br />

Accelerating Augmented Reality: The <strong>Metaio</strong> AREngine<br />

The AREngine and <strong>the</strong> journey to<br />

<strong>the</strong> first AR-ready smartphone<br />

Nearly a decade ago, to <strong>the</strong> day, Thomas Alt and Peter<br />

Meier founded <strong>Metaio</strong> with <strong>the</strong> intent of advancing<br />

Augmented Reality (AR) as <strong>the</strong> primary interface for<br />

experiencing <strong>the</strong> digital and online worlds. This was a<br />

time when <strong>the</strong> most popular mobile device’s (<strong>the</strong> Nokia<br />

1100) features were limited to SMS and a calculator.<br />

The dawn of <strong>the</strong> era of <strong>the</strong> smartphone really did<br />

change everything for <strong>the</strong> Augmented Reality industry,<br />

as suddenly <strong>the</strong> average user could experience through<br />

mobile cameras <strong>the</strong> same visual elements formerly<br />

restricted to factory-floor AR installations running on<br />

offline high-powered PCs.<br />

Back <strong>the</strong>n it was clear that computer vision and<br />

Augmented Reality experiences would greatly benefit<br />

from optimizing <strong>the</strong> software for individual handsets and<br />

chipset platforms. It was <strong>the</strong>n that <strong>Metaio</strong> embarked on<br />

developing relationships with OEMs, handset manufacturers<br />

and chipset platforms in order to one day realize a<br />

fully optimized device, ready for Augmented Reality from<br />

<strong>the</strong> moment <strong>the</strong> consumer removes it from <strong>the</strong> shelf.<br />

Despite hardware limitations, <strong>Metaio</strong> was able to make<br />

leaps and bounds with applied research and lowlevel<br />

optimizations. Their award-winning R&D team<br />

was responsible for <strong>the</strong> first commercial deployment<br />

of 3-D tracking and recognition on a mobile device.<br />

<strong>Metaio</strong>’s engineers were also <strong>the</strong> first to align a given<br />

4<br />

smartphone camera with gravity, educating <strong>the</strong> sensor<br />

on how to better perceive its surroundings like <strong>the</strong> human<br />

eye. In fact, <strong>Metaio</strong> has made incredible software<br />

developments in 2012 alone.<br />

In 2009, it was no less than a technological feat to get<br />

a top-of-<strong>the</strong>-line HD camera connected to an offline<br />

desktop PC to recognize a single pre-designed image<br />

and render a single 3-D model in real-time. With <strong>the</strong><br />

latest low-level optimizations, <strong>Metaio</strong> has achieved<br />

recognizing 100 unique images and overlaying 100<br />

unique 3-D models, all on a mobile device. If <strong>Metaio</strong><br />

can accomplish <strong>the</strong>se things without having any prior<br />

access to <strong>the</strong> processors and sensors inside <strong>the</strong>se devices,<br />

imagine what mobile users could do with a fully<br />

AR-ready smartphone.<br />

Whe<strong>the</strong>r it’s Google’s Project: Glass concept or popular<br />

movies like Minority Report or Terminator, nearly all of<br />

<strong>the</strong> popular references to Augmented Reality depict an<br />

“always on” interface. The camera is constantly scanning,<br />

detecting, recognizing and overlaying information<br />

and content onto <strong>the</strong> real world. In order to achieve this<br />

vision (something <strong>Metaio</strong> refers to as <strong>the</strong> “Augmented<br />

City”) of ubiquitous interaction, it is imperative that <strong>the</strong><br />

groups developing <strong>the</strong> hardware are working with those<br />

developing <strong>the</strong> software.<br />

For this reason, <strong>Metaio</strong> began developing a piece of<br />

hardware IP now known as <strong>the</strong> “AREngine”, an architecture<br />

designed specifically to accelerate Augmented<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


Reality performance in mobile hardware, and one of<br />

<strong>Metaio</strong>’s longstanding platform partners, ST-Ericsson,<br />

will be <strong>the</strong> first to adopt and deploy it on silicon. The<br />

AREngine will propel Augmented Reality into <strong>the</strong> future<br />

and will do for <strong>the</strong> industry what <strong>the</strong> addition of <strong>the</strong> GPU<br />

did for <strong>the</strong> gaming industry.<br />

Before <strong>the</strong> populace sports head mounted displays that<br />

resemble eyeglasses; before society adopts wearable<br />

computing; before contact lenses come in 16, 32 and<br />

64 gigabyte models; before we exist in an Augmented<br />

World – <strong>the</strong>re must be <strong>the</strong> first step. The future of<br />

Augmented Reality starts now with <strong>the</strong> first ever introduction<br />

and implementation of <strong>the</strong> AREngine.<br />

Always On. Always Augmented.<br />

<strong>Metaio</strong> AREngine Features<br />

→ Higher performance enables an increase in scale and volume<br />

of Augmented Reality<br />

→ Faster initialization on 3-D point clouds allows for an increase<br />

in <strong>the</strong> volume and size of <strong>the</strong> 3-D point cloud<br />

→ Dramatic reduction in power consumption will allow for Allday<br />

AR experiences<br />

→ “Always on” of Augmented Reality usage for current & future<br />

devices requiring continuous AR visualization & search<br />

→ AREngine modules can be customized to meet <strong>the</strong><br />

semiconductors requirements<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

<strong>Metaio</strong> and Mobile World Congress<br />

a rich history of introducing <strong>the</strong> latest advances in AR<br />

Throughout <strong>the</strong> years <strong>Metaio</strong> and its partners have served as<br />

Augmented Reality ambassadors at <strong>the</strong> Mobile World Congress,<br />

delivering insightful speaking sessions, appearing in multiple<br />

technology panels and showcasing <strong>the</strong> latest technology on <strong>the</strong><br />

show floor.<br />

2010<br />

<strong>Metaio</strong> works with Sony Ericsson to showcase<br />

<strong>the</strong> latest image recognition technology on Sony<br />

Ericsson’s newest Android device at <strong>the</strong> time.<br />

2011<br />

<strong>Metaio</strong> demonstrates breakthroughs in mobile AR<br />

with Intel – including <strong>the</strong> first 3-D object recognition<br />

and tracking – and announces <strong>the</strong> first of many strategic<br />

OEM partnerships to come with ST-Ericsson.<br />

2012<br />

<strong>Metaio</strong> releases its Augmented City platform,<br />

complete with <strong>the</strong> first 3-D object recognition<br />

and tracking, to <strong>the</strong> entire mobile community,<br />

presenting its technology at <strong>the</strong> booths of multiple<br />

prominent OEMs, including ARM, Intel, Texas<br />

Instruments and, of course, ST-Ericsson.<br />

Junaio, <strong>the</strong> most advanced mobile Augmented Reality<br />

browser app is a fast and easy way to discover your<br />

world. Find local events, offers and listings; scan QR<br />

codes to get instant access to additional information;<br />

unlock augmented content on images and objects to<br />

play games or experience new virtual interactions.<br />

Broadway<br />

0.5mi<br />

focus The <strong>Metaio</strong> AR Engine<br />

0.1mi<br />

Madame<br />

Tussauds<br />

0.4mi<br />

Times Square<br />

for iOS and Android<br />

www.junaio.com<br />

5


features The <strong>Metaio</strong> Creator<br />

Spotlight on <strong>Metaio</strong> Creator, AR in Minutes<br />

The Internet would be nothing<br />

without content.<br />

The same is true for <strong>the</strong> Augmented Reality industry.<br />

Though <strong>Metaio</strong> works regularly with industrial and automotive<br />

clients on internal projects that <strong>the</strong> public rarely<br />

sees, <strong>the</strong> consumer side of augmented reality benefits<br />

from creative and engaging content, often created by<br />

partners and developers in <strong>the</strong> mobile community.<br />

The <strong>Metaio</strong> Creator had very humble beginnings as an<br />

online companion to <strong>Metaio</strong>’s mobile augmented reality<br />

browser, Junaio, to help new AR developers publish<br />

simple experiences. As <strong>the</strong> AR ecosystem evolved, so<br />

did <strong>the</strong> product. <strong>Metaio</strong> recognized that more than just<br />

developers needed to have access to development<br />

tools. Originally intended as a solution for <strong>the</strong> print industry,<br />

it became clear to <strong>Metaio</strong> that <strong>the</strong> technology<br />

appealed to a broader audience.<br />

Even today a still growing community of artists, designers<br />

and creative professionals involved with mixed and<br />

digital media want to use Augmented Reality as <strong>the</strong> next<br />

medium – and it was for that group of people that <strong>Metaio</strong><br />

released <strong>the</strong> first iteration of <strong>the</strong> Creator tool, a simple<br />

drag & drop desktop publishing solution that removed<br />

<strong>the</strong> need for programming.<br />

In October of 2012 <strong>Metaio</strong> announced at its annual<br />

InsideAR technology conference that it would introduce<br />

scalable augmented reality software and services<br />

6<br />

to <strong>the</strong> technology community in order to aid in <strong>the</strong><br />

creation of compelling AR content. Following InsideAR<br />

2012, <strong>Metaio</strong> heeded <strong>the</strong> requests of its burgeoning<br />

network and added better 3-D content support, native<br />

app creation capability, and cloud service offerings to<br />

<strong>the</strong> Creator, in addition to a version for OS X.<br />

Now nearly anyone can create augmented reality experiences<br />

and applications in just a few minutes and <strong>the</strong><br />

opportunities and potential uses increase exponentially.<br />

A creatively-minded person could simply augment his<br />

or her business card with a virtual resume or introduction;<br />

family members could attach <strong>the</strong> latest videos<br />

or images of important events to holiday greetings; a<br />

publisher could bring <strong>the</strong> most featured editorial content<br />

to life on <strong>the</strong> cover of a magazine or newspaper; a<br />

digital marketer could turn a print campaign into a fully<br />

integrated digital masterpiece, connecting <strong>the</strong> virtual<br />

assets with every physical aspect of <strong>the</strong> experience; or<br />

he or she could use <strong>the</strong> graphical user interface (GUI)<br />

designer to build a custom mobile AR application, all<br />

with just a few clicks.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

Learn more at www.metaio.com/products/creator or stop by our<br />

booth at <strong>the</strong> 2013 Mobile World Congress in App Planet, Hall 8.1,<br />

booth 8.1E39 to talk to a member of our team.


Augmented Reality in just 3 steps with <strong>the</strong> <strong>Metaio</strong> Creator<br />

The creation of Augmented Reality experiences and<br />

scenarios has been, until recently, reserved for developers<br />

and programmers. Thanks to <strong>the</strong> <strong>Metaio</strong> Creator, a<br />

new AR authoring tool, editors, designers, students, and<br />

marketing agencies can create and visualize <strong>the</strong>ir own<br />

Augmented Reality ideas, concepts and applications<br />

without any programming knowledge necessary.<br />

Get started creating an Augmented Reality scenario in<br />

minutes with <strong>the</strong>se 3 easy steps:<br />

1. Upload your trackables and your digital content<br />

(videos, 3-D and/or 2-D assets, buttons, audio,<br />

etc.) by dragging & dropping <strong>the</strong>m directly into <strong>the</strong><br />

<strong>Metaio</strong> Creator. Files are automatically converted and<br />

optimized for <strong>the</strong> Augmented Reality scenario, and<br />

<strong>the</strong> trackables are evaluated and rated based on <strong>the</strong>ir<br />

quality for image recognition during <strong>the</strong> upload.<br />

2. Create your experience with just a few clicks… Align<br />

digital elements like buttons, videos or 3-D models<br />

with <strong>the</strong> trackable by dropping elements from <strong>the</strong><br />

Resources panel right onto <strong>the</strong> trackable image or<br />

3-D map. The application logic creates itself!<br />

3. Publish your Augmented Reality experience with just<br />

one click to junaio or <strong>the</strong> metaio cloud and try it out<br />

immediately on your smartphone or tablet.<br />

metaio Creator Features<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

features AR in Minutes<br />

→ Easy to use software and no developer background required<br />

→ Options to share your videos, images, audio and 3-D<br />

contents with millions of AR users<br />

→ Publish to <strong>Metaio</strong>’s existing AR Browser App, Junaio, with no<br />

app submission<br />

→ Build your own Augmented Reality app, from beginning to<br />

end, with <strong>the</strong> <strong>Metaio</strong> Creator<br />

→ Instant content updates without app resubmission through <strong>the</strong><br />

<strong>Metaio</strong> Cloud<br />

→ Integrated Analytics Manager for your AR campaigns<br />

→ Connected with <strong>the</strong> newest <strong>Metaio</strong> Cloud service<br />

<strong>Download</strong> <strong>Metaio</strong> Creator for FREE!<br />

Try for yourself, start creating AR scenarios using up<br />

to 2 tracking patterns and publish <strong>the</strong>m for free on<br />

<strong>the</strong> junaio AR browser! Available for Mac OSX (version<br />

10.7 & higher) and Windows.<br />

<strong>Download</strong> <strong>the</strong> metaio Creator at:<br />

www.metaio.com/products/creator<br />

7


features AR Excitement for 2013<br />

5 reasons to get excited about Augmented Reality in 2013<br />

Originally posted on venturebeat.com, December 23, 2012<br />

Augmented reality (AR) may seem like a futuristic concept,<br />

but it will be a reality of our digital lives in 2013. AR<br />

is a new technology that blurs <strong>the</strong> line between what’s<br />

real and what’s computer generated by enhancing<br />

what we hear, see and feel. Next year, I predict that it<br />

will be everywhere. Here are my five reasons why:<br />

The glasses are coming, <strong>the</strong> glasses are coming!<br />

Whe<strong>the</strong>r it’s Google’s Project Glass or concept videos<br />

along <strong>the</strong> lines of “Sight”, <strong>the</strong> Internet can’t get<br />

enough of Terminator Vision. A few companies have<br />

however made some pretty impressive technological<br />

leaps this year: this fall, Vuzix debuted <strong>the</strong>ir monocular<br />

AR prototype for industrial use at <strong>the</strong> annual InsideAR<br />

conference; Innovega showcased <strong>the</strong>ir Augmented<br />

Reality contact lens prototype at <strong>the</strong> 2012 Consumer<br />

Electronic show, for which <strong>the</strong>y’re currently seeking<br />

FDA approval; and researchers at <strong>the</strong> University of<br />

Washington successfully displayed a single pixel on an<br />

eye (albeit, that of a rabbit).<br />

In <strong>the</strong> meantime, retails brands like Oakley and game<br />

favorite Valve were just as quick to throw <strong>the</strong>ir hats in <strong>the</strong><br />

ring alongside patent applications from tech giants Apple<br />

and Microsoft. But don’t bo<strong>the</strong>r Santa with your letters<br />

– widely available (and affordable) wearable Augmented<br />

Reality devices probably won’t hit shelves until 2014.<br />

Smartphones will be<br />

AR-equipped<br />

We might not get Paul<br />

Smith AR goggles anytime<br />

soon, but expect OEMs,<br />

handset manufacturers<br />

and carriers to integrate<br />

optimized Augmented Reality, visual display and camera<br />

performance into <strong>the</strong> next generation of smartphones,<br />

because it’s basically already happening.<br />

Premier-to-punchline-to-rising-star Nokia recently<br />

launched <strong>the</strong> City Lens app, exclusive to its Lumia<br />

suite of devices. UK-based chip designer ARM has<br />

8<br />

had its eye on AR for a while, powering and optimizing<br />

experiences for its architecture found in <strong>the</strong> Samsung<br />

Galaxy SII, SIII and Note devices. And let us not forget<br />

Telefonica and <strong>the</strong>ir mad dash to serve mobile<br />

Augmented Reality advertisements to <strong>the</strong> entirety of<br />

<strong>the</strong>ir O2 network, alongside mobile coupons and location-based<br />

services.<br />

Location, Location, Location<br />

GPS and geodata were responsible early on for bringing<br />

Augmented Reality to <strong>the</strong> forefront. Applications<br />

like Junaio and Layar made a splash in <strong>the</strong> tech world,<br />

offering location-based navigational “channels” and “layers”<br />

where UFO-like billboards bobbed on <strong>the</strong> horizon,<br />

displaying information about your surroundings. In 2013<br />

expect to see <strong>the</strong> next generation of those GPS-based<br />

experiences, incorporating not only data from on-board<br />

sensors like <strong>the</strong> gyroscope and camera, but o<strong>the</strong>r niche<br />

mobile technologies that rely on proximity such as NFC.<br />

Companies like Hover are already deeply embedded in<br />

generating and augmenting 3-D maps of urban areas,<br />

and my company (AR firm <strong>Metaio</strong>) has successfully<br />

developed “snapping algorithms” that pull this kind of<br />

data from <strong>the</strong> cloud and tightly align it to <strong>the</strong> real world.<br />

Expect your city to get a lot more augmented in 2013.<br />

The death of <strong>the</strong><br />

gimmicky app<br />

Disclaimer: <strong>the</strong>re will always<br />

be marketers that<br />

abuse useful technology<br />

for <strong>the</strong>ir own nefarious,<br />

poorly designed purposes<br />

(re: QR codes), but expect<br />

to see brands move to better, faster and stronger apps<br />

that give <strong>the</strong>ir audience clear incentives for regular use.<br />

3-D bunnies smiling at you from conference marketing<br />

material may have seemed novel at <strong>the</strong> time, but creating<br />

a new app for each one-off experience is nei<strong>the</strong>r<br />

scalable nor tolerable from a user’s perspective.<br />

The 2013 IKEA Catalog app featured an Augmented<br />

Reality viewer that visualized furniture in 3-D and<br />

served related video and digital content to readers.<br />

It was <strong>the</strong> most downloaded branded app of 2012,<br />

even after launching in July. With that kind of success<br />

as a benchmark, expect o<strong>the</strong>r companies to start<br />

managing entire product lifecycles with Augmented<br />

Reality solutions- not unlike Mitsubishi Electric with<br />

<strong>the</strong>ir enterprise MeViewAR app that visualizes heating<br />

and cooling units in <strong>the</strong> real world. Mitsubishi Electric<br />

has already moved to <strong>the</strong> next phase for 2013, intending<br />

to visualize 3-D maintenance instructions for<br />

service technicians.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


The birth of <strong>the</strong> elusive killer app<br />

It doesn’t exist, and it probably won’t. Augmented<br />

Reality is a horizontal technology, which means that<br />

<strong>the</strong> nigh-limitless applications make it a challenging endeavor<br />

to develop <strong>the</strong> Evernote/YouTube/Wordpress/<br />

Instagram of Augmented Reality. We did however see<br />

<strong>the</strong> AR Angry Birds, and even if it isn’t official it’s still a<br />

pretty clear indication that a successful AR game could<br />

lead <strong>the</strong> way for massive adoption. There are already<br />

some good examples out <strong>the</strong>re, like <strong>the</strong> new JengAR<br />

game that inserts <strong>the</strong> 3-D content into <strong>the</strong> environment<br />

itself ra<strong>the</strong>r than needing a printed image.<br />

Expect more games to take this approach in 2013 as<br />

we move toward experiences that engage users in <strong>the</strong>ir<br />

actual surroundings. But <strong>the</strong> most amazing app for<br />

which <strong>the</strong> industry could possibly hope is only peripherally<br />

related to AR. 3-D content is tough. it’s difficult,<br />

expensive and time-consuming to create, and may present<br />

<strong>the</strong> biggest barrier to producing AR experiences.<br />

Augmented Reality needs an app that easily generates<br />

3-D content and exports it in major supported formats.<br />

Think “Draw Something” meets iMovie, in 3-D. That<br />

would be something!<br />

SOUTH<br />

ENTRANCE<br />

1<br />

2<br />

5<br />

3<br />

7<br />

4<br />

6<br />

8.1<br />

8<br />

NORTH<br />

ENTRANCE<br />

<strong>Metaio</strong> Nominated for 18th Annual<br />

Global Mobile Awards<br />

We’re pleased to announce that <strong>Metaio</strong> has been<br />

nominated for <strong>the</strong> prestigious 2013 Global Mobile<br />

Awards for <strong>the</strong> 2013 Mobile World Congress in<br />

<strong>the</strong> category of Best Mobile Service or Product for<br />

Automotive. As <strong>Metaio</strong> has strong roots in AR applications<br />

for <strong>the</strong> car industry, we’re very proud to have<br />

<strong>the</strong> chance to present with our partner, Audi AG in<br />

Barcelona this year.<br />

<strong>Metaio</strong> and Audi AG worked toge<strong>the</strong>r to develop <strong>the</strong><br />

Audi eKurzinfo Augmented Reality assistant app.<br />

New Audi A1 owners can download <strong>the</strong> app for iOS<br />

devices and get introduced to <strong>the</strong>ir car in just a few<br />

minutes, with no manual necessary. Through <strong>the</strong><br />

app, <strong>the</strong> user can use <strong>Metaio</strong>’s visual search and<br />

recognition technology to identify insignia throughout<br />

<strong>the</strong> vehicle and receive immediate feedback on<br />

how to use that particular feature of <strong>the</strong> new Audi.<br />

The first iteration of <strong>the</strong> Audi eKurzinfo app was<br />

based purely on image recognition. For 2013,<br />

Audi will release <strong>the</strong> brand new version of <strong>the</strong> app<br />

featuring real-time visual graphics and advanced<br />

Augmented Reality interactions. Audi intends to roll<br />

out this service beyond <strong>the</strong> A1, starting with <strong>the</strong> A3<br />

but with <strong>the</strong> potential for future models as well.<br />

If you’re attending <strong>the</strong> Mobile World Congress in<br />

Barcelona this year, please come visit us! In addition<br />

<strong>the</strong> Awards Ceremony, <strong>Metaio</strong> will be in Hall 8.1 at<br />

<strong>the</strong> App Planet, showcasing <strong>the</strong> latest in Augmented<br />

Reality and 3-D technology. We are fortunate to<br />

also have amazing partners like Intel, Imagination<br />

Technology and ST-Ericsson, at whose booths you<br />

can see how <strong>Metaio</strong>’s technology works with some<br />

of <strong>the</strong> best chipset platforms and handsets out <strong>the</strong>re.<br />

Where to find <strong>Metaio</strong> @MWC 2013<br />

metaio ......App Planet, Hall 8.1, Stand 8.1E39<br />

Intel ........App Planet, Hall 8.1, Stand 8.1E20<br />

Imagination ..Hall 7, Stand 7I110<br />

ST-Ericsson ..Hall 7, Stand 7E111<br />

NVIDIA. .....Hall 7 Stand 7C110<br />

ARM .......Hall 6 Stand 6A31<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

features Global Mobile Awards 2013<br />

9


features AR in Construction<br />

Augmented Reality in <strong>the</strong> Construction Industry<br />

Augmented Reality (AR) enhances <strong>the</strong><br />

environment by allowing human senses to<br />

interact with richer and more compelling<br />

experiences through <strong>the</strong> addition of<br />

digital information to <strong>the</strong> real world.<br />

Virtual content can now coexist with <strong>the</strong> tangible world.<br />

The origins of Augmented Reality take <strong>the</strong>ir root from<br />

Ivan Su<strong>the</strong>rland 1965’s piece: “The Ultimate Display”.<br />

Since <strong>the</strong>n, <strong>the</strong> application and interest in AR has grown<br />

exponentially in various industries. While many have<br />

been quick to adopt Augmented Reality, <strong>the</strong> construction<br />

industry has been slow to embrace this new technology.<br />

In order to draw a better picture of <strong>the</strong> state of AR in<br />

<strong>the</strong> construction industry we sent 345 surveys to construction<br />

companies and received 34 responses. The<br />

majority of respondents were European with <strong>the</strong> remaining<br />

participants in North America, South America,<br />

Asia and Australia.<br />

Of <strong>the</strong> 38% already familiar with AR, 23% note <strong>the</strong><br />

technology is already implemented in <strong>the</strong> workplace,<br />

comprising only 9% of <strong>the</strong> responding companies.<br />

Surprisingly enough, nearly 90% said <strong>the</strong>y could think<br />

of ways that Augmented Reality could be useful within<br />

<strong>the</strong>ir respective workplaces.<br />

At this time, AR implementation seems to be restricted<br />

to a few large companies, while smaller building<br />

firms and architect offices are reluctant to adopt new<br />

10<br />

Survey: AR and Construction<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

Are you familiar with AR<br />

Does your company use AR?<br />

Would AR solve problems<br />

at your company?


technology tools due to finite resources. In addition,<br />

it is of note that 40% of those aware of AR but not<br />

yet using it in <strong>the</strong> workplace say that <strong>the</strong> technology is<br />

currently being investigated and that it could be used<br />

in <strong>the</strong> near future.<br />

A demonstration illustrating <strong>the</strong> advantages of AR in <strong>the</strong><br />

construction industry was showcased last year at <strong>the</strong><br />

InsideAR 2012 Augmented Reality conference in Munich,<br />

Germany. The aim of this demonstration was to visualize<br />

how <strong>the</strong> planning of a construction site, with <strong>the</strong> help of<br />

AR, provided significant improvements over traditional<br />

methods. The demo focused on <strong>the</strong> features of engineering<br />

and industrial based Augmented Reality and <strong>the</strong><br />

benefits it is able to bring to <strong>the</strong> construction industry.<br />

Features<br />

→ Virtual elements are augmented into <strong>the</strong> real world in real time<br />

→ Visualization of all devices and equipment involved in <strong>the</strong> project<br />

→ Crane range of motion visible through visualization of its radius<br />

→ See-through 3D radius of cranes models and range of motion<br />

→ Visualization of <strong>the</strong> various connection required to utilities<br />

→ Representation of <strong>the</strong> finished project<br />

→ Visualization of any additional information possible<br />

→ Visualization of <strong>the</strong> overall construction site’s structure and layout<br />

Benefits<br />

→ Planning takes place on site; no paper plan needed<br />

→ Determine optimal orientation and disposal of each and every unit<br />

→ Easily see how accessible <strong>the</strong> material storage and o<strong>the</strong>r<br />

necessary areas are<br />

→ Provides extensive feedback of crane interaction with<br />

surroundings in order to prevent collisions<br />

→ Base <strong>the</strong> layout of you construction site on <strong>the</strong> availability of<br />

utilities and maximize efficiency<br />

→ Instantly see how your construction project looks, interacts &<br />

impacts on <strong>the</strong> surroundings<br />

→ Superimpose <strong>the</strong> construction schedule to monitor <strong>the</strong> deadlines<br />

→ Improved coordination between delivery services and<br />

construction site logistics<br />

Quick Facts - <strong>Metaio</strong> Engineer:<br />

+ =<br />

→ Advantages of AR for Construction & Planning<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

features AR in Construction<br />

→ Reconstruct onsite virtual 3-D assets, materials, prototypes<br />

and environments, in real-time<br />

→ Insert and visualize objects obscured by real-world materials<br />

→ Reduce costs, test processes and simulate project conditions<br />

even in planning stages<br />

→ Visualize completed project in a real-world environment<br />

before it kicks off<br />

→ Optimize a project’s delivery with more efficient prior planning<br />

and design<br />

Learn more about <strong>Metaio</strong> Engineer!<br />

Contact us at sales@metaio.com for more information<br />

on what you can achieve with <strong>Metaio</strong> Engineer and<br />

industrial AR.<br />

www.metaio.com/products/engineer<br />

11


features Android Fragmentation<br />

The Difficulties of being Droid<br />

The first smartphone running Google’s<br />

Android mobile operating system was<br />

released in October 2008. Today, 1.3<br />

million android devices are activated<br />

daily, 70,000 of which are tablets.<br />

Due to it’s nature as an open platform, Android can<br />

be installed on any kind of device, with any kind of<br />

hardware, including different graphic capabilities,<br />

completely different and non-homogeneous screen<br />

sizes, different user inputs, on both high and low end<br />

devices. Android has even been seen running on cars,<br />

ovens and refrigerators. There are seemingly no limits<br />

when it comes to <strong>the</strong> myriad of devices and electronics<br />

that can run Android.<br />

This, however, presents a problem for companies and<br />

developers bringing applications, games, books, movies,<br />

music and magazines to <strong>the</strong> Google Play store.<br />

This problem is called fragmentation and is a result of<br />

nearly unlimited device variations and configurations, in<br />

respect to both <strong>the</strong> hardware and software.<br />

Developers want to take this fragmentation issue and<br />

make it work to <strong>the</strong>ir benefit, but clearly cannot be<br />

expected to make a single application for all Android<br />

devices and have it to work perfectly on every single<br />

one. For this reason, companies and developers are<br />

spending extra time and effort on <strong>the</strong>ir applications and<br />

optimizing <strong>the</strong> user interfaces to fit on every screen size<br />

or at <strong>the</strong> very least, <strong>the</strong> widest possible range of sizes,<br />

resolutions and combinations of screen orientations.<br />

Today, 1.3 million Android<br />

devices are activated daily<br />

Imagine great-looking app optimized for a smartphone<br />

with a smaller screen. How will it look when running on<br />

a different phone with a larger screen, or on a tablet<br />

in landscape orientation? On a higher resolution display,<br />

<strong>the</strong> interface components can be adjusted and<br />

positioned in a more visually engaging manner, or more<br />

information can be shown on <strong>the</strong> display. In regards to<br />

tablets, retaining <strong>the</strong> same layout may result in a waste<br />

of <strong>the</strong> usable screen real estate, resulting in <strong>the</strong> need<br />

to vary <strong>the</strong> user interface again or create a completely<br />

different version of <strong>the</strong> application.<br />

Introduced alongside Android 3.0 (Honeycomb), <strong>the</strong><br />

Fragments API has made it much easier to create an application,<br />

based on fragments, which is also backwards<br />

compatible with earlier Android devices. Fragments<br />

make it possible for developers to define sections of<br />

<strong>the</strong> user interface as individual units that can adjust<br />

12<br />

<strong>the</strong>ir location on screen depending on <strong>the</strong> screen size,<br />

resolution and orientation of <strong>the</strong> device. Now Android<br />

developers have <strong>the</strong> power to ensure that <strong>the</strong>ir applications<br />

offer quality user-experiences with less worry<br />

about which device <strong>the</strong> user may have in <strong>the</strong>ir hands.<br />

This is great for app development in general, and especially<br />

for Augmented Reality applications. With <strong>the</strong><br />

flexibility of <strong>the</strong> devices that <strong>the</strong> Fragments API allows<br />

developers to target, less time is necessary for user<br />

interface adjustments and backwards compatibility<br />

issues, allowing more time to be spent enhancing,<br />

perfecting and delivering <strong>the</strong> best Augmented Reality<br />

experiences possible. Augmented Reality is great for<br />

tablets and devices with larger displays, but users with<br />

smaller devices should also be able to easily experience<br />

all of <strong>the</strong> amazing AR content and applications<br />

being offered.<br />

The <strong>Metaio</strong> SDK for Android is also <strong>the</strong> only available<br />

augmented reality software with which developers can<br />

create native Android apps. In conjunction with <strong>the</strong><br />

Fragments API, developers not only have a much easier<br />

time optimizing applications for different devices, but<br />

can also rely on <strong>the</strong>ir creations to work as intended for<br />

<strong>the</strong> user or client. And one of <strong>the</strong> huge benefits of <strong>the</strong><br />

so-called fragmentation of <strong>the</strong> Android OS is that <strong>the</strong><br />

plentitude of devices running Android mean more users<br />

and more clients to reach in one of <strong>the</strong> largest mobile<br />

audiences in <strong>the</strong> world.<br />

And with Android expanding to automobiles and maybe<br />

even connected home appliances, developers will have<br />

myriad opportunities to create new experiences and interactions<br />

for all aspects of our daily lives. Windshields,<br />

mirrors, refrigerator “desktops”- and of course, Glass.<br />

Ei<strong>the</strong>r way, <strong>the</strong>y can rely on <strong>the</strong> <strong>Metaio</strong> Augmented<br />

Reality SDK to get <strong>the</strong>re.<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


The LEGO Digital Box Augmented Reality Kiosk<br />

An eye-catching in-store AR solution for<br />

<strong>the</strong> most iconic toy company in <strong>the</strong> world<br />

Purchase decisions at <strong>the</strong> point of sale are mostly<br />

driven by <strong>the</strong> excitement of customers about a product.<br />

This certainly applies to <strong>the</strong> toy market.<br />

Customers tend to want to examine and interact with<br />

products before purchasing <strong>the</strong>m. Though LEGO is<br />

one of <strong>the</strong> world’s most renowned toy companies, consumers<br />

can only really interact with <strong>the</strong> product after<br />

purchasing, returning home and assembling it. LEGO<br />

wanted a way for potential consumers to engage with<br />

<strong>the</strong>ir toys ahead of time, so <strong>the</strong>y opted for an Augmented<br />

Reality point-of-sale experience to show <strong>the</strong> customer<br />

product features and to stimulate customers’ emotions<br />

towards <strong>the</strong> product.<br />

<strong>Metaio</strong> developed a custom AR application for LEGO<br />

based on <strong>the</strong> <strong>Metaio</strong> SDK - <strong>the</strong> LEGO Digital Box. The<br />

application relies on image detection and tracking to<br />

recognize <strong>the</strong> different LEGO boxes and visualize 3-D<br />

animations of <strong>the</strong> finished LEGO models directly on top<br />

of <strong>the</strong> product packaging, complete with sound effects.<br />

The application was designed modularly so that content<br />

updates can be performed painlessly. Fur<strong>the</strong>rmore,<br />

statistical evaluation has shown a positive impact on<br />

<strong>the</strong> consumer experience and o<strong>the</strong>r targets of LEGO in<br />

regards to <strong>the</strong> DIGITAL BOX.<br />

Children can now hold LEGO packaging up to <strong>the</strong><br />

DIGITAL BOX and watch a 3-D animation of <strong>the</strong> product,<br />

from any angle and in every detail - all in <strong>the</strong>ir<br />

hands. The installation not only creates a fascinating<br />

technological experience, but also gives in-store retailers<br />

a unique positioning opportunity to educate and<br />

influence purchasing decisions.<br />

“The DIGITAL BOX helps consumers get a better<br />

impression of our products,” says Torben Nielsen,<br />

Director of 3D technology from LEGO Group’s Digital<br />

Development Department, and adds: “We’ve had very<br />

positive feedback from our stores and customers.<br />

Thanks to <strong>Metaio</strong>’s technology, we can excite and inform<br />

our customers on a new level.”<br />

Quick Facts<br />

→ Start of <strong>the</strong> initial evaluation phase in November 2008<br />

→ Worldwide brand store rollout began in April 2010<br />

→ Using <strong>the</strong> <strong>Metaio</strong> SDK<br />

→ Bringing customer excitement to a new level<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

fragments LEGO Digital Box<br />

→ Most successful Augmented Reality application worldwide<br />

13


fragments <strong>Metaio</strong> Enterprise Solutions<br />

Mitsubishi Electric Cooling & Heating Relies on<br />

Augmented Reality Enterprise Solutions from <strong>Metaio</strong><br />

To boost adoption of its ductless air conditioning and<br />

heating products, Mitsubishi Electric Cooling & Heating<br />

needed to more effectively show consumers what an<br />

installed unit would look like in <strong>the</strong>ir home. As a result of<br />

deploying <strong>the</strong> metaio Enterprise Solution (MES), a mobile<br />

augmented reality app, to each of its sales channel<br />

representatives. Mitsubishi Electric has projected an<br />

increase of $30 million in revenue. They also forecast<br />

decreasing by millions <strong>the</strong> future costs for printing and<br />

distributing product catalogs.<br />

The latest innovations in comfort technology and energy-efficient<br />

ductless HVAC systems are provided<br />

by Mitsubishi Electric Cooling & Heating, a division of<br />

Mitsubishi Electric & Electronics USA, Inc. Ductless<br />

systems are 30% more energy-efficient than unitary<br />

HVAC and offer personalized comfort control in each<br />

room or zone.<br />

Mitsubishi Electric provides sales tools, technical support<br />

and training to contractors, distributors, engineers and<br />

architects on its award-winning line of variable refrigerant<br />

flow (VRF) and ductless systems for commercial and<br />

residential, respectively, installations. With over 25,000<br />

contractors and 1,500 distributors nationwide, Mitsubishi<br />

Electric needed a solution to streamline <strong>the</strong> delivery of<br />

information and education of its sales channel.<br />

Gabriel Weiss, head of Interactive Marketing Technologies<br />

for Mitsubishi Electric, recognized a number of issues with<br />

<strong>the</strong> company’s multi-faceted communication network.<br />

Weiss found redundancies and shortcomings, including<br />

marketing strategies that competed with each o<strong>the</strong>r.<br />

14<br />

For example, product and pricing information in print<br />

catalogs was becoming out of date before <strong>the</strong> next<br />

catalog was even drafted. They need a solution that<br />

could be updated year-round. And while product was<br />

pictured in <strong>the</strong>se print catalogs, being able to show <strong>the</strong><br />

product actually in <strong>the</strong> customer’s space would answer<br />

<strong>the</strong> most frequently asked question from customers,<br />

“What will it look like on my wall?”.<br />

Mitsubishi Electric Cooling and<br />

Heating is generating an additional<br />

$30 million in annual sales by<br />

visualizing products with <strong>the</strong><br />

metaio Enterprise Solution<br />

Weiss’ vision for Mitsubishi Electric is “Using technology<br />

to sell our technology,” so <strong>the</strong> value of having a<br />

custom-branded app through which products could be<br />

“seen” was invaluable.<br />

“Using <strong>the</strong> metaio augmented reality technology we<br />

are able to give our customers a mobile product visualization<br />

tool that is completely unique to our industry.<br />

Giving <strong>the</strong>m a competitive advantage and making <strong>the</strong><br />

sales process more efficient for <strong>the</strong>m.”<br />

To visualize a unit exactly as it would appear installed in<br />

a customer’s home, Mitsubishi Electric sales representatives<br />

simply place a 18-inch by 18-inch Post-It Note<br />

marker on <strong>the</strong> wall where <strong>the</strong> unit should appear and<br />

launch <strong>the</strong> meVIEW AR app on an iPad. When <strong>the</strong><br />

user points <strong>the</strong> iPad’s camera towards <strong>the</strong> marker, <strong>the</strong><br />

product is automatically displayed to scale where <strong>the</strong><br />

marker is on <strong>the</strong> wall. The user can <strong>the</strong>n tap to place<br />

any product on <strong>the</strong> same location and share of photo<br />

of it via email with family or project decision makers.<br />

Using this technology, products can be visualized in<br />

any location throughout a customer’s home or office.<br />

Mitsubishi Electric also opted to include social features,<br />

so that photos taken of <strong>the</strong> augmented experience can<br />

be posted to Twitter and Facebook.<br />

Learn more about <strong>Metaio</strong> AR<br />

Enterprise Solutions<br />

Contact sales@metaio.com for more information<br />

on how <strong>Metaio</strong> Enterprise Solutions can solve your<br />

Augmented Reality needs.<br />

www.metaio.com/enterprise<br />

3 4 5 6 7 8 9 10 11 12 13 14 15


InsideAR: The Augmented Reality Conference<br />

Meet <strong>Metaio</strong> all over <strong>the</strong> world<br />

GPU Technology Conference<br />

March 18-21, 2013 – San Jose, California<br />

http://www.gputechconf.com/page/home.html<br />

Game Developers Conference<br />

March 25-29, 2013 – San Francisco, CA<br />

http://www.gdconf.com/<br />

Gartner CIO Leadership Forum<br />

March 17-19, 2013 - Huntington Beach, CA<br />

http://www.gartner.com/technology/summits/na/cio/<br />

South By Southwest Interactive<br />

March 8-12, 2013 - Austin, TX<br />

http://sxsw.com/<br />

PAX East<br />

March 22-24, 2103 – Boston, MA<br />

http://east.paxsite.com/<br />

Augmented World Expo<br />

June 4-5, 2013 - Santa Clara, CA<br />

http://augmentedworldexpo.com/<br />

events<br />

October 2013 - Munich, Germany<br />

Discover <strong>the</strong> future of Augmented Reality at <strong>the</strong> annual InsideAR Augmented Reality Conference, hosted<br />

by <strong>Metaio</strong>. Visit <strong>the</strong> AR Live-expo and experience Augmented Reality hands-on with exhibits and demos<br />

presented by, <strong>Metaio</strong>, <strong>the</strong>ir partners and <strong>the</strong> growing community of certified developers. Keynotes and presentations<br />

from industry experts will take place during <strong>the</strong> conference, giving you insight into <strong>the</strong> numerous ways<br />

Augmented Reality is changing <strong>the</strong> world we know.<br />

For more information visit www.metaio.com/insideAR<br />

CeBIT ISMAR<br />

March 5-9, 2013 - Hannover, Germany<br />

CeBIT is <strong>the</strong> world’s largest trade fair showcasing<br />

digital IT (information technology) and telecommunications<br />

solutions for home and work environments.<br />

The key target groups are users from industry, <strong>the</strong><br />

wholesale and retail sectors, skilled trades, banks,<br />

<strong>the</strong> services sector, government agencies, science<br />

and all users passionate about technology.<br />

Learn More at http://www.cebit.de/<br />

3 4 5 6 7 8 9 10 11 12 13 14 15<br />

October 1-4, 2013 - Adelaide, SA, Australia<br />

The 2013 ISMAR (International Symposium on<br />

Mixed and Augmented Reality) conference showcases<br />

<strong>the</strong> diversity and quality of work in Mixed and<br />

Augmented Reality, with a top-quality collection of<br />

workshops, tutorials, panels, papers, posters, and<br />

late advances in Science & Technology and Art,<br />

Media and Humanities programs.<br />

Learn More at http://ismar.vgtc.org/<br />

15


The Augmented Reality Magazine<br />

www.metaio.com

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!