26.04.2022 Views

Smart Industry No.1 2022

Smart Industry No.1 2022 - The IoT Business Magazine - powered by Avnet Silica

Smart Industry No.1 2022 - The IoT Business Magazine - powered by Avnet Silica

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

smart<br />

powered by<br />

industry<br />

The IoT Business Magazine<br />

7.50 EUR No. 01.<strong>2022</strong><br />

THE FUTURE<br />

OF IOT<br />

KEEP ON<br />

TRUCKIN’<br />

Fixing the Logistics<br />

Bottleneck<br />

CURRENT<br />

TRENDS<br />

EV Charging<br />

Means Business<br />

Internet<br />

of Trees<br />

A Better Way<br />

to Fight Forest Fires<br />

The Age of the Digital Human<br />

THE MAN MACHINE


XILINX INNOVATIONS<br />

GET STARTED<br />

WITH YOUR DESIGN<br />

WINNING THE 5G RACE<br />

Wherever 5G drives innovation, from over the air, satellite<br />

to ground, and private network to 4.0 automation, cutting<br />

edge 5G applications require both increased bandwidth,<br />

and fast computing into a lower power and smaller form<br />

factor radio.<br />

The RFSoC product family’s breakthrough integration<br />

translates to lower power, a smaller footprint, and higher<br />

performances. It enables demanding 5G applications such<br />

as multi operators, 400MHz iBW, Multi Carriers, Sub 6GH<br />

and MMwave, whilst supporting ease of use and flexibility<br />

of design evolution.<br />

By enabling a ‘Radio in One chip’ design (from O-RAN interfaces<br />

to RF) with high performance and low power, the Zynq<br />

RFSOC family provides significant benefits for applications<br />

that require fast computing at a lower cost.<br />

avnet-silica.com


Editorial<br />

Creating<br />

the Future<br />

Tim Cole<br />

is editor-in-chief of<br />

<strong>Smart</strong> <strong>Industry</strong> –<br />

the IoT Business Magazine.<br />

<strong>Smart</strong> homes and factories, smart clothing<br />

(so-called “wearables”), autonomous<br />

cars, trucks and drones and other<br />

stuff from the world of science fiction<br />

have become everyday phenomena that introduced<br />

the world to IoT technology and its<br />

giant potential. The continued growth of this<br />

technology and its use has created a global IoT<br />

market of $389 billion, which is forecasted to<br />

reach $1 trillion in 2030 (according to Statista).<br />

IoT allows the physical world to be integrated<br />

into computer-based systems, which, in turn,<br />

helps to improve the efficiency of the systems<br />

and reduces human intervention. So we’ve<br />

come a log way, right?<br />

And it’s everywhere, effecting industries from<br />

transportation (shipment & tracking), retail<br />

(inventory management) hospitality (voice<br />

assistants) to healthcare (health & wellness<br />

monitoring).<br />

Let’s take a closer look at some of them.<br />

In retail, the global market for IoT is expected<br />

to reach $182.04 billion by 2028 according to a<br />

report by Grand View Research. Much of this<br />

growth will be due to advances and reduced<br />

cost for IoT hardware and sensors, etc., but improvements<br />

in customer experience through<br />

much increased customer tracking and personalization<br />

are expected to be the real drivers.<br />

Using beacons, brands or retail stores can<br />

attract passersby to visit their stores by sending<br />

IoT-enabled notifications to their smartphones.<br />

The Internet of Things connecting<br />

everything to everything also means connecting<br />

to everyone.<br />

Supply chain optimization will not only unlock<br />

the bottleneck for stuff that has stifled both retails<br />

waiting for shipments from Asia but manufacturers<br />

of cars and sophisticated electronic<br />

systems desperate for chips. IoT sensors do not<br />

just track location, but also humidity, temperature,<br />

tilt, shock, speed and driving behaviors,<br />

meaning that logistics teams can determine if<br />

their stuffs safe, on time and has been transported<br />

under the right conditions, thus avoiding<br />

loss and spoilage.<br />

In <strong>Smart</strong> Factories, or as the Europeans prefer<br />

to call it, <strong>Industry</strong> 4.0 machines, will take over<br />

mundane and repetitive tasks on the assembly<br />

line, freeing qualified workers for more<br />

demanding tasks where lack of talent is being<br />

felt around the world. Using powerful AI tools<br />

such as image recognition and analysis, manufactures<br />

will dramatically raise quality with<br />

hope of achieving the golden grail of making<br />

stuff – zero-reject production.<br />

The hospitality business rocked by lack of people<br />

willing to work for sweatshop wages will<br />

have to invest heavily in automation provided<br />

by IoT in everything from “connected rooms”<br />

where everything from temperature control to<br />

room service to lowering the blinds and turning<br />

on the TV will be guided by Alexa-style<br />

gadgets and smartphone that enhance the<br />

guest experience. And in maintenance where<br />

hotels spend a lot, IoT sensors can help to reduce<br />

this expenditure by detect problem and<br />

notify staff, for instance about faulty lighting<br />

and other fixes.<br />

The Internet of Things brings numerous opportunities<br />

for any business to transform itself.<br />

Companies like our sponsor Avnet Silica<br />

and many others will be happy to point out<br />

ways in which, you, too, can reap the benefits<br />

of IoT a myriad of practical use cases and applications.<br />

In you aren’t there yet, setting out<br />

on your journey to the connected future has<br />

never been easier. Bon voyage!<br />

3


contents Imprint<br />

CONTENTs<br />

03 Editorial<br />

04 Contents/Imprint<br />

06 <strong>Smart</strong> People<br />

24<br />

Welcome to the Metaverse<br />

Online communities have existed since at least the mid-1980s, but the metaverse could represent<br />

a whole new dimension. Imagine it as an online virtual world which incorporates augmented<br />

reality, virtual reality, 3D holographic avatars, video and other means of communication. As<br />

the metaverse expands, it will offer a hyper-real alternative world for you to coexist in.<br />

<strong>Smart</strong> Business<br />

12 The Man Machine: Building a Better Brain<br />

24 The Metaverse: No Time for Fun & Games<br />

29 Avnet Column: Gilles Beltran<br />

30 The Future of IoT<br />

34 Interview: Lou Lutostanski<br />

38 Why IoT Projects Fail<br />

42 IIoT: How to Eat an Elephant<br />

<strong>Smart</strong> Communications<br />

46 Keep on Trucking<br />

52 Taking Security to the Edge<br />

58 EV Charging: Current Trends<br />

58<br />

Current Trends<br />

The electric vehicle industry is on its way to market maturity but there are still twists in the road<br />

for stakeholders and customers. From accessibility and standardization issues to a lack of convenient<br />

and secure payment methods at charging stations, unresolved issues could still throw a<br />

spoke in the wheel of electric vehicles, leaving full adoption out of reach.<br />

<strong>Smart</strong> Lifestyle<br />

62 The <strong>Smart</strong>est City<br />

66 Internet of Trees: Fighting Forest Fires with IoT<br />

72 Taking 5G to the Max<br />

76 Interview: The World is Shrinking<br />

<strong>Smart</strong> Solutions<br />

78 Old Data for Sale<br />

82 Lidar<br />

86 Bernd Schöne: Liquid Software<br />

88 <strong>Smart</strong> Sensors: <strong>Smart</strong> Eyes for IoT<br />

90 <strong>Smart</strong> Companies<br />

92 One More Thing<br />

62<br />

The <strong>Smart</strong>est City<br />

Poblenau, formerly a run-down suburb of Barcelona, has reinvented itself as a neighbourhood<br />

buzzing with innovative startups, research centres and international businesses.<br />

Today, it is regularly touted as a template for urban, economic and social renewal, as well as<br />

a hotbed of IT innovation.<br />

98 Gerd Leonhard: The Future Looks Great!<br />

4


12<br />

The Man Machine<br />

The idea of linking the human brain to machines and<br />

to each other is intriguing and far from new. But now<br />

the dream of countless Sci-Fi readers may be coming<br />

true at last. Will we soon be able to control our smart<br />

machines simply through thought? Maybe it’s time to<br />

rethink our relationship with technology.<br />

IMPrint<br />

Publisher<br />

Avnet Silica (Avnet EMG GmbH), Gruberstrasse 60d,<br />

85586 Poing, Germany<br />

Production and Project Management<br />

RSP Management GmbH, Hohenbrunner Weg 41B,<br />

82024 Taufkirchen, rspitz@rsp-publishing.de<br />

Square Publishing GmbH,<br />

Bretonischer Ring 10, 85630 Grasbrunn<br />

Project manager Richard Spitz<br />

Editor-in-chief Tim Cole<br />

Text editor Eric Doyle<br />

Art director Sara D’Auria, www.inframedesign.de,<br />

Harald Sayffaerth, www.01graphics.de<br />

Contributors Göran Appelquist, Gilles Beltran,<br />

Rainer Claaßen, Marc McCoy, Sebastian Ganschow,<br />

Alan Earls, Gordon Feller, John Koon, Greg Langley,<br />

Tom Leddo, Gerd Leonhard, Michael Moorfield,<br />

Stian Overdahl, Bernd Schöne<br />

Pictures Shutterstock, Fotolia<br />

Production manager Stephan Quinkertz<br />

Printing Westermann<br />

Managing director Richard Spitz, Stephan Quinkertz<br />

© <strong>2022</strong> RSP Management GmbH and<br />

Square Publishing GmbH<br />

INTRODUCING THE MICROSOFT AZURE<br />

SPHERE ENABLED LORA GATEWAY<br />

One of the most secure and easy to manage<br />

gateways, featuring Azure Sphere<br />

• Securely monitors, tracks and manages data in<br />

almost every environment, from buildings to factories,<br />

smart cities, hospitals, agriculture and retail<br />

• Supports cellular, Wi-Fi and Ethernet connectivity<br />

• Remotely upgrade your gateways in the field, with<br />

daily authentication of hardware and software,<br />

and a failsafe over the air update mechanism<br />

• Guaranteed maintenance over the lifetime of<br />

the product<br />

• Pre-integrated security will ensure that your<br />

LoRaWAN gateway is secure and safe of the risk<br />

from cyber-attacks<br />

avnet-silica.com<br />

REQUEST<br />

DEMO


<strong>Smart</strong> People Behind the scenes<br />

Behind the Scenes<br />

<strong>Smart</strong> people<br />

All over the world, brilliant individuals are hard at work creating the technologies and<br />

solutions that will one day make the Internet of Things come alive. We visited a few<br />

of them and listened to their fascinating stories.<br />

Stockholm University<br />

Artificial Intelligence<br />

for the Planet<br />

Swedish resilience researcher<br />

Victor Galaz believes that artificial<br />

intelligence should follow the<br />

dictates of sustainability in the<br />

context of the environment and<br />

climate change. “Like many other<br />

technologies, artificial intelligence<br />

offers a mixture of opportunities<br />

and risks with regard to climate<br />

change,” he says.<br />

Crunching the<br />

Climate Numbers<br />

While AI offers more<br />

postive than negative<br />

impacts on the climate,<br />

more work still<br />

needs to be done to<br />

extract correlations<br />

from the mountains<br />

of data available.<br />

As associate professor in political<br />

science and deputy director of<br />

the Stockholm Resilience Centre<br />

at Stockholm University, Galaz recently<br />

gave a much-discussed lecture<br />

on Planetary Responsible AI at<br />

the Complexity Science Hub Vienna<br />

(CSH), where he focused on the<br />

ethical perspective of AI which he<br />

maintains must always be included<br />

in the design and use of AI systems<br />

– whether to design them according<br />

to principles of inclusion and diversity,<br />

or to reflect on the dilemmas of<br />

self-driving cars which one day may<br />

have to decide on the life and death<br />

of road-using humans.<br />

That AI offers numerous opportunities<br />

to halt or even reverse climate<br />

change is obvious: relevant patterns,<br />

changes or correlations can<br />

be extracted automatically from the<br />

growing mountains of data resulting<br />

from the monitoring of our environment.<br />

Galaz emphasises that the predictive<br />

power of artificial intelligence offers<br />

a major advantage. He believes<br />

A Positive impacts of Al: 79 % (71 %) B Negative impacts of Al: 35 % (23 %)<br />

source ©: Springer Nature Limited<br />

17<br />

12<br />

13<br />

9<br />

15<br />

8<br />

1<br />

100%<br />

100%<br />

14<br />

(100%) 75%<br />

(88%) (69%) 3<br />

90%<br />

69%<br />

(90%)<br />

(69%)<br />

80%<br />

100% 4<br />

(70%)<br />

(93%)<br />

26%<br />

56%<br />

(15%)<br />

(44%)<br />

82%<br />

100%<br />

(59%)<br />

(100%)<br />

90%<br />

100%<br />

(75%)<br />

(100%)<br />

10 100%<br />

100%<br />

(91%) 92% 58% (90%)<br />

7<br />

(77%) (52%)<br />

Enviroment: 93% (85%)<br />

Economy: 70% (55%)<br />

16<br />

2<br />

11<br />

6<br />

5<br />

Society: 82% (77%)<br />

17<br />

12<br />

13<br />

9<br />

15<br />

8<br />

1<br />

86%<br />

33% (43%) 25%<br />

(8%)<br />

3<br />

14<br />

30%<br />

(13%) 8%<br />

(13%)<br />

(8%)<br />

20%<br />

70% 4<br />

(20%)<br />

(60%)<br />

11%<br />

33%<br />

(5%)<br />

(31%)<br />

27%<br />

63%<br />

(16%)<br />

(28%)<br />

70%<br />

40%<br />

(55%)<br />

(40%)<br />

10 50%<br />

20%<br />

(34%) 33% 25% (10%)<br />

7<br />

(25%) (15%)<br />

Enviroment: 30% (12%)<br />

Economy: 33% (23%)<br />

16<br />

2<br />

11<br />

6<br />

5<br />

Society: 38% (25%)<br />

1 No Poverty<br />

2 Zero Hunger<br />

3 Good Health and Well-Being<br />

4 Quality Education<br />

5 Gender Equality<br />

6 Clean Water and Sanitation<br />

7 Affordable and Clean Energy<br />

8 Decent Work and Economic Growth<br />

9 <strong>Industry</strong>, Innovation, and Infrastructure<br />

10 Reduced Inequalities<br />

11 Sustainable Cities and Communities<br />

12 Responsible Consumption and Production<br />

13 Climate Action<br />

14 Life Below Water<br />

15 Life on Land<br />

16 Peace, Justice and Strong Institutions<br />

17 Partnerships<br />

6


that, with improved data availability,<br />

predictive modeling of climate data<br />

will make it possible to estimate developments<br />

ever more accurately<br />

and locally. AI already plays a role in<br />

the optimisation of existing systems<br />

– for example, in the more efficient<br />

use of renewable energies.<br />

High benefits also require the responsible<br />

use of the systems and<br />

Galaz's central question is: “How do<br />

we ensure that AI does not intensify<br />

environmental degradation, misinformation<br />

and social inequality?”<br />

Artificial intelligence is already being<br />

used in many variations in the<br />

field of smart farming worldwide,<br />

for example, using satellite data to<br />

optimise irrigation, pesticide use<br />

and harvesting times. To Galaz, it is<br />

unclear what ecological effects such<br />

digital agriculture, forestry and water<br />

management will have and this<br />

AI offers a mix<br />

of opportunities<br />

and risks.<br />

Victor Galaz<br />

Associate professor in<br />

political science and deputy<br />

director of the Stockholm Resilience<br />

Centre at Stockholm<br />

University<br />

raises a social question. Galaz asks:<br />

"Will the advantages resulting from<br />

automation be evenly distributed or,<br />

for example, will it have a negative<br />

impact on small farmers in African or<br />

Asian countries?”<br />

source ©: Goethe-Institut<br />

AN ENGINEER’S<br />

GUIDE TO 5G –<br />

AVNET SILICA’S NEW<br />

RESOURCE FOR<br />

DESIGNERS<br />

There has never been a better<br />

time to accelerate your 5G design<br />

journey. From infrastructure<br />

to endpoint, 5G will reach into<br />

every aspect of our business and<br />

personal lives. And there is no<br />

better place to fuel that journey<br />

than Avnet Silica’s 5G solutions<br />

page.<br />

DOWNLOAD<br />

EBOOK<br />

avnet-silica.com


<strong>Smart</strong> People Behind the scenes<br />

source ©: LinkedIn Corporation<br />

source ©: Davey Bickford Enaex source ©: Aspermont Media Ltd<br />

Davey Bickford Enaex<br />

Having a Blast and<br />

Still Staying Safe<br />

The most dangerous moment in<br />

mining is when someone lights<br />

the fuse and everybody starts<br />

running. Aymeric Denuelle, a<br />

researcher and group product<br />

marketing manager at mining<br />

How to Achieve a<br />

Better Blast<br />

IoT enhanced<br />

detonators provide<br />

a higher level of accuracy<br />

and reliability,<br />

improving blast performance<br />

while offering<br />

a user friendly<br />

human machine<br />

interface allowing<br />

fast programming.<br />

Time is money<br />

in the mining<br />

industry.<br />

Aymeric Denuelle<br />

Researcher and group<br />

product marketing manager<br />

at mining services company<br />

Davey Bickford Enaex<br />

services company Davey Bickford<br />

Enaex, wants to defuse the situation<br />

with its DaveyTronic Edge<br />

remote control electronic detonator.<br />

The system uses a common<br />

IoT radio frequency protocol to<br />

communicate with up to thousands<br />

of detonators before triggering<br />

each explosive device.<br />

Electronic detonators have been<br />

around since the 90s but, Denuelle<br />

says, they had an Achilles heel<br />

because the complex fixed-wire<br />

networks connecting the detonators<br />

to the blasting machines<br />

were prone to electrical leakage.<br />

Early wireless detonators were<br />

unidirectional – in other words,<br />

signals could be sent to a detonator,<br />

but no response could be<br />

received. DaveyTronic Edge not<br />

only does away with the need<br />

for surface wiring but also controls<br />

multiple electronic detonators<br />

from a single, safe location,<br />

thereby making the blasting<br />

process less risky and more efficient.<br />

Until now, mining workers were<br />

forced to manually check conditions<br />

before pressing the button<br />

– a process known as ‘priming<br />

the blast’. This is costly and<br />

time consuming, as well as risky<br />

in the event of human error,<br />

but the main worry was finding<br />

detonators that failed to go off,<br />

which meant searching for hours<br />

through huge piles of debris.<br />

The new system has been successfully<br />

tested in a large mine in<br />

Chile, where it proved capable of<br />

operating safely over a distance<br />

of several kilometres. As Denuelle<br />

says, “Our goal is to always<br />

provide safer solutions so that<br />

our customers can trigger larger<br />

blasts from a remote firing point.<br />

Time is money in this industry and<br />

mining companies need to spend<br />

more time collecting the ore than<br />

organising the blast."<br />

8


MORE EXPERTISE<br />

LESS COMPLEXITY<br />

Bipolar<br />

transistors<br />

Diodes Analog &<br />

MOSFETs GaN FETs<br />

Logic ICs<br />

ESD protection, TVS, filtering<br />

and signal conditioning<br />

It’s never been easier to complete your design, with essential components and expert support from<br />

Nexperia. Search & specify all your discrete and MOSFET components, analog and Logic ICs, directly online.<br />

You’ll quickly find what you need from our portfolio of 15,000+ devices, industry-leading small packages,<br />

meeting the highest industry standards.<br />

For easy access to the essential components, get more with Nexperia.<br />

nexperia.com


<strong>Smart</strong> People Behind the scenes<br />

Omni:us<br />

Taking a Flyer<br />

on Insurance AI<br />

"I like to take risks. That's how I was<br />

brought up", says Sofie Quidenus-<br />

Wahlforss, founder and CEO of<br />

Omni:us, based in Berlin. The serial<br />

entrepreneur founded her first<br />

company in Vienna while still attending<br />

high school. Now, with<br />

Omni:us, her fourth company,<br />

she is using artificial intelligence<br />

to disrupt the insurance industry.<br />

Following the company’s launch<br />

Quidenus-Wahlforss made the<br />

Forbes list of Europe's Top 50 Women<br />

in Tech.<br />

"When I was a little kid, I used to<br />

climb to the top of the tallest trees,"<br />

she recalls, adding that it was always<br />

important to her parents that<br />

she gained as much experience as<br />

possible. "When I fell from the tree,<br />

that was also an experience and it<br />

showed that I was brave."<br />

Omni:us uses artificial intelligence<br />

to digitally capture documents,<br />

including handwritten ones, to<br />

automatically evaluate them and<br />

understand what they are about.<br />

As a kid, I used<br />

to climb to the<br />

top of the tallest<br />

trees.<br />

Sofie<br />

Quidenus-Wahlforss<br />

Founder and CEO<br />

of Omni:us, based in Berlin<br />

Omni:us Classifies<br />

Documents<br />

into predefined<br />

categories based<br />

on visual and<br />

textual information<br />

and retrieves data<br />

using end2end information<br />

extraction<br />

techniques.<br />

The system learns as it goes and<br />

its analytical skills get increasingly<br />

better. Omni:us is focusing on the<br />

insurance industry. "That's where<br />

we see the greatest potential because<br />

everyone deals with insurances,"<br />

Quidenus-Wahlforss maintains.<br />

The startup earns money by<br />

selling licenses for its software.<br />

As an entrepreneur, she has learned<br />

to deal with setbacks. "I can only<br />

do this if I believe in it," she says.<br />

Quidenus-Wahlforss is firmly convinced<br />

that artificial intelligence is<br />

source ©: omni:us / Qidenus Group GmbH<br />

capable of taking the paperwork<br />

away from an insurance company's<br />

clerks so that they have more time<br />

for their customers’ needs. "It's not<br />

about replacing the employee but<br />

enabling them to focus on what<br />

they can do; namely, empathic<br />

behaviour," she explains. "No one<br />

wants a machine to end up making<br />

decisions."<br />

International investors have apparently<br />

been won over by this<br />

idea, investing a total of around<br />

€20 million in Omni:us. Many large<br />

insurance companies are already<br />

working with Omni:us, currently<br />

one of the largest German insurers<br />

Wüstenrot is running a proof-ofconcept<br />

test project.<br />

Omni:us is part of the Qidenus<br />

Group, which may look like a misspelling.<br />

In fact, Quidenus-Wahlforss<br />

had the “u” removed deliberately<br />

– something her parents<br />

and her grandmother, in particular,<br />

remain irritated about. "I kind of<br />

thought it was cooler without the<br />

‘u’," Sofie explains. "Qi is the Chinese<br />

word for energy and if you flip<br />

the letters around it's IQ. Both just<br />

fit well."<br />

source ©: omni:us / Qidenus Group GmbH<br />

10


nRF9160<br />

Low power cellular SiP with integrated<br />

LTE-M/NB-IoT modem and GPS<br />

Start your development today with the most<br />

compact, complete and energy-efficient<br />

cellular IoT solution on the market<br />

AVAILABLE NOW<br />

nordicsemi.com/nRF9160


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

Augmented Humanity<br />

THE<br />

MAN MACHINE<br />

Psychokinesis, or mind over matter, is a popular dream<br />

of sci-fi and horror story writers. In the digital world, dreams often come<br />

true and there are signs that soon we may be able to complete tasks<br />

without moving off our sofas. Remote control is changing<br />

to cerebral control – if you think it, you can do it.<br />

n By Alan R. Earls<br />

The idea of linking humans<br />

with the machines we have<br />

created and to each other is<br />

intriguing and far from new.<br />

Today, many people carry a multitude<br />

of electronic signatures and<br />

interfaces. The smartphone is the<br />

most obvious and most capable,<br />

but credit cards also carry chips<br />

with personal information and, with<br />

the pandemic ongoing, the idea of<br />

chipping vaccinated people is not<br />

out of the realm of possibility – and<br />

let’s not forget our biometric signatures.<br />

Despite their usefulness, all<br />

of these require manual manipulation.<br />

Maybe it’s time to rethink the<br />

processes by just thinking about the<br />

process.<br />

Science fiction has ridden the concept<br />

of controlling things with the<br />

power of the mind for years, notably<br />

Firefox, a Clint Eastwood thriller involving<br />

a thought-controlled fighter<br />

jet. The reality of this has been<br />

getting closer of late.<br />

Facebook shared ideas about<br />

thought-to-text capabilities in 2017,<br />

shortly after entrepreneur Elon<br />

Musk announced his plans to build<br />

Neuralink, a firm promising to `wire’<br />

brains in the future. Startups and<br />

research projects are now emerging<br />

across the globe and the key<br />

to much of this future is the `brain<br />

computer interface’ (BCI).<br />

Alexandre Gonfalonieri, an AI consultant<br />

based in Switzerland and<br />

head of innovation at DNA<br />

12


13


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

source ©: Ars Electronica Linz GmbH & Co KG<br />

To Think it is to<br />

Do it<br />

Wacker Neuson<br />

challenged visitors<br />

to Ars Electronica in<br />

Linz to operate its<br />

heavy construction<br />

equipment entirely<br />

by eye movement<br />

and thought control.<br />

Your BCI could<br />

detect that your<br />

attention level is<br />

too low or adapt<br />

the lighting<br />

based on how<br />

stressed you are.<br />

Alexandre Gonfalonieri<br />

DNA Global Analytics<br />

nual expo in Linz, Austria, that celebrates<br />

advances in digitalisation,<br />

Wacker Neuson, a British manufacturer<br />

of heavy construction equipment,<br />

challenged visitors to steer a<br />

15-ton backhoe excavator entirely<br />

by eye movement and brain power.<br />

The company envisages applications<br />

for this new technology in controlling<br />

heavy machinery in tight or<br />

hazardous environments where human<br />

operators would be in danger.<br />

Release the Beast<br />

A lot comes down to definitions,<br />

says Evan Coopersmith, executive<br />

VP of data science at AE Studio, a<br />

source ©: Medium<br />

Global Analytics, recently wrote in<br />

the Harvard Business Review, “The<br />

development of BCI technology<br />

was initially focused on helping paralysed<br />

people control assistive devices<br />

using their thoughts, but new<br />

use cases are being identified all the<br />

time. For example, BCIs can now be<br />

used as a neuro-feedback training<br />

tool to improve cognitive performance.<br />

I expect to see a growing<br />

number of professionals leveraging<br />

BCI tools to improve their performance<br />

at work. For example, your<br />

BCI could detect that your attention<br />

level is too low, compared with the<br />

importance of a given meeting or<br />

task, and trigger an alert. It could<br />

also adapt the lighting of your office<br />

based on how stressed you are or<br />

prevent you from using your company<br />

car if drowsiness is detected.”<br />

Imagine, Gonfalonieri says, if your<br />

manager could know whether you<br />

actually paid attention in your last<br />

Zoom meeting. Imagine if you could<br />

prepare your next presentation using<br />

only your thoughts. Scenarios<br />

like this might soon become a reality<br />

thanks to developments in the field.<br />

BCIs may even find their way into<br />

such mundane tasks as steering an<br />

excavator. At Ars Electronica, an ansoftware<br />

development and data<br />

science venture studio that conducts<br />

projects for clients and also<br />

funds its own BCI research. “Right<br />

now, we think of BCI in terms of<br />

something internal to a person<br />

manifesting as external action,”<br />

he says. Is a cochlear implant BCI?<br />

Yes, says Coopersmith, though he<br />

admits that others might disagree<br />

with that assessment. A BCI could<br />

also be a device that notifies the<br />

brain of an oncoming seizure. “I<br />

would say anything that is a neurological<br />

interface that connects the<br />

brain to the outside world, in either<br />

direction, is BCI and I think those<br />

boundaries will increasingly blur,”<br />

he explains.<br />

The work AE Studio is pursuing<br />

is leading edge but without any<br />

literal cutting edge involved. Coopersmith<br />

says implanting devices<br />

in someone’s skull is not the name<br />

of the game. Rather, he sees an<br />

opportunity to make better use of<br />

what can be learned from brain activity<br />

to get to a much more powerful<br />

kind of interface than is available<br />

today.<br />

“Our expertise is in software development<br />

and machine learning,<br />

and in understanding data,”<br />

14


Invasive IoT<br />

The Internet of Bodies<br />

IoB Examples<br />

source ©: RAND Corporation<br />

Cochlear<br />

implant<br />

Electronic<br />

tattoo<br />

Self-lacing<br />

shoes<br />

Bluetoothconnected<br />

diaper<br />

Wearable baby<br />

monitor<br />

Depression headset<br />

Augmented reality<br />

contact lens<br />

Wearable UV monitor<br />

Pacemaker<br />

Microchip implant<br />

<strong>Smart</strong>phone with<br />

health apps<br />

Prosthetic<br />

Temperature-sensing pacifier<br />

Antidrowning monitor<br />

Sleep-tracking onesie<br />

Brain interfaces may be a future goal<br />

but, here and now, WiFi devices are<br />

increasingly becoming integral to<br />

the delivery of quality healthcare.<br />

Common devices such as sleep<br />

trackers and heart monitors are a<br />

reality but researchers at The Rand<br />

Corporation, a think-tank, want to<br />

take the link between humans and<br />

machines a step further – literally.<br />

Swallow and Collect<br />

They imagine an era of the Internet<br />

of Bodies: a range of devices that<br />

can be implanted, swallowed or<br />

worn in order to collect and transmit<br />

data about our physical states<br />

over the internet. The result will be a<br />

huge amount of health-related data<br />

that could improve human wellbeing<br />

and prove crucial in fighting the<br />

Covid-19 pandemic.<br />

VivaLNK, a startup based in Silicon<br />

Valley, for instance, has developed<br />

smart thermometers marketed under<br />

the brand name Fever Scout.<br />

Unlike traditional thermometers,<br />

which usually involve long tubes,<br />

Intraocular lens<br />

with camera<br />

Internet-connected<br />

glasses<br />

Tooth-mounted<br />

sensor<br />

Electronic pill<br />

Clothing with<br />

temperature monitoring<br />

Fertility measurement<br />

device<br />

Internet-connected<br />

scale<br />

Internet-connected<br />

toilet<br />

VivaLNK has created peel-and-stick<br />

thermopatches that connect via a<br />

smartphone app and have already<br />

received Food and Drug Administration<br />

(FDA) clearance in the US.<br />

The company believes its product<br />

is especially suitable for monitoring<br />

child patients.<br />

For health professionals, the Internet<br />

of Bodies opens the gate to a<br />

new era of effective monitoring and<br />

treatment. In 2017, the US Federal<br />

Drug Administration approved the<br />

first use of digital pills in the United<br />

States. Digital pills contain tiny, ingestible<br />

sensors as well as medicine.<br />

Once swallowed, the sensor is activated<br />

in the patient’s stomach and<br />

transmits data to a smartphone or<br />

other devices.<br />

Meditation headset<br />

Bluetooth-connected<br />

hearing aid<br />

<strong>Smart</strong> watch/<br />

fitness tracker<br />

Temperature bracelet<br />

Artificial pancreas<br />

Electronic health<br />

records (EHRs)<br />

Sleep-sensing<br />

mattress<br />

Not Just a Patch-over<br />

VivaLnk, a Santa Clara-based<br />

connected health startup, has<br />

received FDA clearance for its<br />

first device, a peel-and-stick<br />

patch thermometer for children<br />

called Fever Scout.<br />

IoT Gets Physical<br />

From AR contact lenses to artificial<br />

pancreas and Bluetooth<br />

connected diapers: No part of<br />

the human body will remain<br />

untouches by IoB technology,<br />

says RAND.<br />

Virtual Rehab<br />

In 2018, Kaiser Permanente, a healthcare<br />

provider in California, started a<br />

virtual rehab programme for patients<br />

recovering from heart attacks.<br />

The patients shared their data with<br />

their care providers through a smartwatch,<br />

allowing for better monitoring<br />

and a closer, more continuous<br />

relationship between patient and<br />

doctor. Thanks to this innovation,<br />

the completion rate of the rehab<br />

programme rose from less than 50<br />

percent to 87 percent, accompanied<br />

by a fall in the re-admission rate and<br />

programme cost.<br />

Scientists at The Rand Corporation<br />

are studying the rapid growth of<br />

this technology, as well as the broad<br />

privacy and policy issues these developments<br />

raise. In particular, they<br />

are trying to assess the benefits and<br />

risks, the regulatory picture, and<br />

how best to balance risks and rewards<br />

going forward.<br />

source ©: Wareable Ltd<br />

15


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

Silent Speech<br />

Close, but not Close<br />

Enough (Yet)<br />

source ©: Facebook<br />

Giving AR and VR<br />

a Hand<br />

Sean Keller, Meta's<br />

head of research,<br />

is inventing soft,<br />

lightweight haptic<br />

gloves that can bring<br />

full hand presence<br />

into AR and VR.<br />

Housed in its top-secret Skunkworks<br />

tucked away in Building 8 on<br />

Meta’s campus in Menlo Park, Facebook<br />

Reality Labs (FRL) worked on a<br />

project to build a headset or headband<br />

to allow people to send text<br />

messages by thinking – tapping<br />

them out at 100 words per minute.<br />

Though last year Facebook decided<br />

16<br />

Touchie Feelie<br />

To deliver a realistic<br />

sense of touch, a haptic<br />

glove needs hundreds of<br />

actuators (tiny motors)<br />

all over the hand, moving<br />

in concert in a way that<br />

makes the wearer feel<br />

like they’re touching a<br />

virtual object.<br />

Scientists from the<br />

University of San<br />

Francisco<br />

working with Facebook<br />

have developed a wearable<br />

prototype that uses<br />

near-infrared light to measure<br />

blood oxygenation<br />

in the brain and indirectly<br />

measure brain activity in a<br />

safe, non-invasive way.<br />

source ©: Facebook<br />

to put this ‘silent speech’ project on<br />

the backburner for a while, Regina<br />

Dugan, who was then head of the<br />

Building 8 hardware division, remains<br />

a believer. “It sounds impossible<br />

but it’s closer than you realise,”<br />

she told Technology Review.<br />

It now seems it was not quite close<br />

source ©: Facebook<br />

enough. In a blog post last April,<br />

FRL research director Sean Keller<br />

said the team was happy to say that<br />

“for the first time, someone with<br />

severe speech loss has been able to<br />

type out what they wanted to say<br />

almost instantly, simply by attempting<br />

to speak”. However, he added<br />

that Facebook decided to transfer<br />

its results to the broader neuroscience<br />

community, effectively releasing<br />

it into the wild where it will<br />

continue its existence as an opensource<br />

project.<br />

“While we still believe in the longterm<br />

potential of head-mounted<br />

optical BCI technologies, we’ve<br />

decided to focus our immediate efforts<br />

on a different neural interface<br />

approach that has a nearer-term<br />

path to market: wrist-based devices<br />

powered by electromyography,”<br />

he explained. Electromyography<br />

(EMG) is a technique for analysing<br />

and recording the electrical activity<br />

produced by skeletal muscles.<br />

EMG can pick up and decode the<br />

signals for hand and finger movements<br />

at the wrist and translate<br />

them into digital commands for a<br />

device. In the near term, these signals<br />

will let people communicate<br />

with their devices with a degree of<br />

control that’s highly reliable, subtle,<br />

personalisable and adaptable to<br />

many situations. As this area of research<br />

evolves, EMG-based neural<br />

interfaces have the potential to dramatically<br />

expand the bandwidth<br />

with which we can communicate<br />

with our devices, opening up the<br />

possibility of things like high-speed<br />

typing.


source ©: UPMC, Pitt Health Science<br />

he says. No two brains are identical<br />

and they can produce a broad<br />

range of electrical responses. The<br />

challenge, he believes, is understanding<br />

how to interpret those<br />

responses and fit that knowledge<br />

into other evidence and, thereby,<br />

enhance our means of interacting.<br />

Coopersmith’s other aspiration is<br />

to see BCI developed by neutral<br />

parties rather than big, for-profit<br />

enterprises that may be tempted<br />

to use what they learn to supercharge<br />

their marketing. “The risk is<br />

both for some upstart looking to<br />

become the next Facebook/Meta,<br />

as well as Meta itself attempting to<br />

gain even more intimate access to<br />

our thought patterns,” he says. “We<br />

see this [approach to BCI] as aligning<br />

with the goals of a Web3 or Web<br />

3.0 that is more decentralised than<br />

what we have today.”<br />

For now, BCI is still mostly useful<br />

for people who have some degree<br />

of diminished agency, for example<br />

those dealing with paralysis, but<br />

here, too, targets are shifting. “We<br />

don’t know how we will define<br />

agency in 20 to 50 years; we went<br />

from a 12-second flight on a beach<br />

[the Wright brothers, 1903) to landing<br />

on the moon [1969], events<br />

separated by just 66 years,” Coopersmith<br />

notes. “It is hubristic to<br />

predict what BCI will do.” Nonetheless,<br />

it seems likely that human beings<br />

will increasingly interact with<br />

the world and each other through<br />

the mediation of technology.<br />

Pittsburgh's<br />

RNEL<br />

lab is investigating<br />

the feasibility<br />

of using<br />

intracortical<br />

microelectrode<br />

arrays implanted<br />

in motor cortex<br />

for providing<br />

high degree of<br />

freedom control<br />

of a robotic arm.<br />

The pandemic<br />

accelerated<br />

our plans for<br />

in-home testing<br />

but this has<br />

been a goal for<br />

a long time.<br />

Jennifer L. Collinger<br />

University of Pittsburgh<br />

Rehab Neural Engineering<br />

Labs (RNEL)<br />

The direction things are heading is<br />

obvious. In May of this year, a team<br />

of neural engineers at the University<br />

of Pittsburgh’s Rehab Neural<br />

Engineering Labs (RNEL) published<br />

a proof-of-principle for a bidirectional<br />

BCI – a type of BCI that enables<br />

not just data reading but also<br />

provides feedback through data<br />

writing abilities.<br />

Taking Control<br />

In other words, it enables patients<br />

with paralysis to control a rosource<br />

©: UPMC, Pitt Health Science<br />

source ©: University of Pittsburgh, Rehab Neural Engineering Labs<br />

17


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

botic arm using their thoughts and<br />

enables them to feel how hard the<br />

arm is clutching an object. Study<br />

participants were able to take control,<br />

without assistance from the researchers,<br />

to perform difficult tasks<br />

from home.<br />

Jennifer Collinger, the senior author<br />

on this report, believes this proves<br />

that BCI studies no longer need to<br />

be restricted to an on-site lab. “The<br />

pandemic accelerated our plans for<br />

in-home testing but this has been a<br />

goal for a long time,” she explains.<br />

“We need to get the technology<br />

into real-world environments. We<br />

just want study participants to be<br />

able to do the things they want to<br />

do with a BCI.”<br />

It’s All in Your Head<br />

BCI is in fact already an industry<br />

segment of significant size. A recent<br />

study, Brain Computer Interface<br />

source ©: Next Reality, WonderHowTo<br />

The new Reality<br />

Qualcomm's latest<br />

AR headset supports<br />

seven cameras,<br />

including two internal<br />

cameras for eye<br />

tracking and four external<br />

cameras which<br />

give the wearer the<br />

capability of spatial<br />

mapping.<br />

Market Size, Share & Trends Analysis<br />

Report by Grand View Research, an<br />

Indian consultancy, says the global<br />

brain-computer interface market<br />

size was valued at $1.2 billion in<br />

2019 and is anticipated to grow<br />

at an annual rate of 15.5 percent<br />

through 2027.<br />

According to this report, braincomputer<br />

interface technology is<br />

increasingly used in mobile and<br />

virtual gaming industries by integrating<br />

BCI within virtual reality<br />

(VR) headsets. Virtual gaming has<br />

opened a plethora of new opportunities<br />

for mind-controlled headsets<br />

and gadgets, which is further<br />

driving the adoption of brain-controlled<br />

interface technology. Manufacturers<br />

are increasingly focusing<br />

Elon Musk in his Own Words<br />

“A FitBit in Your Skull”<br />

"Think of Neuralink like a FitBit in<br />

your skull. Or an Apple Watch. So,<br />

we take out part of the skull, we replace<br />

that with the chip and the inductive<br />

charger and the Bluetooth<br />

antenna, and it's really quite, almost<br />

literally, like a FitBit in your skull."<br />

From an interview with Kara Swisher<br />

of the New York Times<br />

source ©: Wikipedia / Heisenberg<br />

“I want to be clear, the early applications<br />

will really just be for people<br />

who have a serious brain injury, like,<br />

where it's, like, the value of the implant<br />

is just enormous.”<br />

From Cnet<br />

“Neuralink will seek to solve a number<br />

of neurological diseases. In<br />

the next few years, we'll hopefully<br />

18


on the development of BCI-enabled<br />

video games. Grand View believes<br />

innovations such as these, are likely<br />

to drive the market for brain-controlled<br />

computer interface technology<br />

over the next few years.<br />

International Data Corporation<br />

(IDC) is taking a wider view of the<br />

market, one that includes technologies<br />

such as augmented and virtual<br />

reality (AR/VR), biometrics, exoskeletons,<br />

affective computing, ingestibles,<br />

injectables, implantables,<br />

wearables, and smart devices, as<br />

well as brain-computer interfaces.<br />

The research firm predicts that the<br />

Apple's Private Eyes<br />

The much-rumored Apple<br />

Glasses won't be on the<br />

market until 2023. But<br />

details have leaked out. A<br />

new Apple patent mentions<br />

“privacy eyewear" that aim<br />

to stop people snooping on<br />

your iPhone's display.<br />

source ©: Martin Hajek / iDrop News<br />

European segment of this augmented<br />

humanity (AH) market will reach<br />

over $50 billion by the start of <strong>2022</strong><br />

and more than $100 billion by 2025.<br />

Augmented humanity removes<br />

accessibility barriers that limit humans<br />

from performing their daily<br />

tasks, according to IDC. AH aims to<br />

empower people by developing<br />

data-driven, tech-based, innovative<br />

solutions to enable them to<br />

perform at levels they could not<br />

achieve before.<br />

IDC's The Future of Augmented Humanity<br />

in Europe: 2020–2025 Forecast<br />

estimates that investments in<br />

AH technologies will surge as both<br />

people and corporations invest<br />

in tech to improve their quality of<br />

life and achieve enhanced ways of<br />

working.<br />

Consumer needs change fast but<br />

streamlining and automating domestic<br />

and routine tasks rebe<br />

able to help someone who is a<br />

paraplegic walk again, or someone<br />

whose arms are paralyzed use a<br />

computer again. We hope to have<br />

our first human trials in the next six<br />

months or so.”<br />

From TechWeek Italia<br />

“I think you would, in principle, you<br />

would be able to communicate very<br />

quickly and with far more precision<br />

language, I’m not sure what would<br />

happen to language but in a situation<br />

like this though, it’d be kind of<br />

like the matrix. You want to speak<br />

a different language, no problem.<br />

just download the program.”<br />

From Designboom<br />

“The technology being developed<br />

by Neuralink will allow us to integrate<br />

with computers to access and<br />

process information just as well as<br />

our AI counterparts. Essentially, our<br />

brains will have our very own AI in<br />

a cloud that our brains can synthesize<br />

with as needed. We already<br />

source ©: Neuralink<br />

interface with our computers on a<br />

regular basis, so the jump from an<br />

external device to an internal one<br />

would be a natural progression.“<br />

From Teslarati<br />

“With the direct neural interface,<br />

we can improve the bandwidth<br />

between your cortex and your digital<br />

tertiary layer by many orders of<br />

Doing by Thinking<br />

Thanks to its latest<br />

brain implant, Neuralink<br />

has enabled<br />

a monkey to play<br />

video games through<br />

thought control.<br />

magnitude. I'd say probably at<br />

least 1,000 or maybe 10,000 or<br />

more. And we could also spend<br />

a lot more time thinking about<br />

interesting things, as opposed to<br />

taking complex thought structures,<br />

compressing them down<br />

into words which will also gain<br />

a very low bitrate and then having<br />

someone else receive those<br />

words, decompress them and<br />

then send words back at you.”<br />

From Clubhouse<br />

“The output of the human brain.<br />

This is excruciatingly slow, compared<br />

to, for example, the high<br />

bandwidth of the visual interface<br />

with the brain – the eyes<br />

of people. In other words: data<br />

comes in quickly, but to talk or<br />

type? That process is really slow.<br />

His idea is to capture thoughts<br />

and convert them into text or<br />

movement. Then the humanity<br />

would communicate a lot more<br />

efficiently.“<br />

From superhumantalks<br />

19


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

VR<br />

Allows the user<br />

to see and hear what<br />

the avatar sees<br />

Gloves<br />

with electrical contacts<br />

at the base of the f<br />

ingers and electrodes<br />

between fingers<br />

Face Projection<br />

Images of the face are<br />

important for the<br />

colleagues experience<br />

Surface EMG<br />

Electrodes<br />

For recording heart rate<br />

and skin moisture<br />

source ©: Human Fusions Institute, Case Western Reserve University<br />

IMUs<br />

Inertial measurement<br />

units<br />

embedded in the<br />

shirt to record<br />

arm movement<br />

Electrode<br />

Mesh<br />

This mesh will<br />

cover muscles of the<br />

arm and chest<br />

Network<br />

Mimicked<br />

Movement<br />

Positional feedback<br />

from the user<br />

Touch<br />

Images of the face are<br />

important for the<br />

colleagues experience<br />

SENSA<br />

The SENSA skeleton<br />

is based on the<br />

RE2 HDMS arms<br />

mains a priority, according to the<br />

report. In fact, investments in smart<br />

devices and wearables will remain<br />

high and will drive a significant<br />

share of the overall AH market.<br />

At the same time, businesses are<br />

searching for tech-based ways to<br />

drive innovation and achieve relevant<br />

key performance indicators<br />

(KPIs), such as lowered costs, increased<br />

productivity and improved<br />

safety. Integration is key and IDC<br />

predicts that in the future we will<br />

see strong investments in integrated<br />

technologies such as Apple's AR<br />

glasses set to launch in 2023.<br />

A Human Need<br />

“For as long as I can remember, I<br />

wanted to be in medicine. I thought<br />

about going into surgery, growing<br />

up, but I love science and math,”<br />

says Dustin Tyler, director of the<br />

Human Fusions Institute at Case<br />

Western Reserve University (CWRU)<br />

in Cleveland, Ohio. His path took an<br />

evolutionary twist when he was in<br />

high school in the early 1980s and<br />

purchased an Atari 800XL, one of<br />

the first personal computers. “That<br />

explains why I didn’t get married<br />

until I was in my 30s,” he quips.<br />

His love of computers, even in their<br />

Working Together<br />

By directly connecting<br />

the human experience to<br />

the Avatar's experience,<br />

the human and the<br />

robotic system become<br />

symbiotically linked.<br />

The human experiences<br />

the world of the robot.<br />

The robot becomes the<br />

extension of the human<br />

and the human intelligence.<br />

We can learn<br />

from both<br />

Turing and<br />

Minsky.<br />

Dustin Tyler<br />

Human Fusions<br />

Institute Case<br />

Western Reserve<br />

University<br />

primitive form, and trying to understand<br />

how to get them to do what<br />

he wanted reconnected him to his<br />

biological interests and the question<br />

of how our brains control our<br />

bodies.<br />

“The brain obviously is fascinating<br />

and the duality between brain and<br />

computer has been very interesting<br />

to me,” Tyler says. In the past,<br />

Alan Turing said we created computers<br />

to serve us but then Marvin<br />

Minsky came along and said that<br />

these machines actually do things<br />

like humans. That perception has<br />

led to some people thinking that AI<br />

is replacing the brain, he observes.<br />

source ©: Bunny Island GmbH<br />

“We can learn from both Turing and<br />

Minsky,” he concludes.<br />

While happy to quote theoreticians,<br />

Tyler is very much results-oriented.<br />

A project he directed allowed a<br />

student at CWRU to touch, feel and<br />

hold a banana that was 2,300 miles<br />

away at the University of California,<br />

Los Angeles (UCLA). It was more<br />

than just a scientific stunt because<br />

it demonstrated the possibility of<br />

placing a prosthesis somewhere<br />

in the world and via ‘neural reality’<br />

someone can literally feel identical<br />

sensations remotely. Of more<br />

immediate consequence, his team<br />

provided the sensation of physical<br />

touch to a prosthesis so an amputee<br />

could safely pick up his granddaughter<br />

or effectively slice a tomato.<br />

The Human Fusions Institute team<br />

is also aiming to win some, or all,<br />

of the Avatar XPrize, a contest<br />

sponsored by Japan’s All Nippon<br />

Airways, which is focused on the<br />

development of an avatar system<br />

that will transport a human’s sense,<br />

actions and presence to a remote<br />

location in real time, leading to a<br />

more connected world.<br />

Pursuing similar goals is Raviraj<br />

Nataraj at the Stevens Institute of<br />

20


source ©: Stevens Institute of Technology<br />

Technology in Hoboken, New Jersey.<br />

His laboratory is creating instrumented<br />

wearables and virtual<br />

reality environments to leverage<br />

sensory feedback and cognitive<br />

factors for training better movement<br />

functions. Clinical solutions<br />

are being developed for people<br />

with neurotraumas, including spinal<br />

cord injury, stroke, traumatic<br />

brain injury and amputation. Restorative<br />

devices of interest include<br />

sensorimotor prostheses and powered<br />

exoskeletons.<br />

Nataraj explains that the challenge<br />

is to command and control prosthetics<br />

more naturally, through biological<br />

signals. Until now that has<br />

been accomplished through muscle<br />

movement but it could also be<br />

done with the brain. “We currently<br />

take measurements at the brain but<br />

more to see how people respond to<br />

the training we are providing,” he<br />

says. That effort is especially crucial<br />

for people dealing with severe motor<br />

disabilities, for whom signaling<br />

through muscles is problematic.<br />

“The principles have been established<br />

but now it is about how to do<br />

it better so we can have an actual<br />

impact at the clinical level,” says Nataraj.<br />

Cost is also an issue, he admits<br />

because specialised, sophisticated<br />

products typically carry a high price<br />

tag.<br />

Gaming the World<br />

Cost associated with new, experimental<br />

technology has often been<br />

addressed by finding a larger-scale<br />

market to drive prices down. While<br />

serious and critical needs in human<br />

wellness and the military are top<br />

targets for BCI, a surprising level of<br />

interest has also materialised in the<br />

‘fun’ segments such as gaming.<br />

The dream here is to create total<br />

immersion into a game world<br />

by linking the gamer’s cognitive<br />

The principles<br />

have been<br />

established<br />

but now it's<br />

about how to<br />

do it better.<br />

Raviraj Nataraj<br />

Stevens Institute<br />

of Technology<br />

A Step Ahead<br />

Researchers have<br />

created a powered,<br />

individualized orthosis<br />

that can automatically<br />

adapt the level<br />

of response, but their<br />

goal is to eventually<br />

get rid of the robot and<br />

walk normally without<br />

the exoskeleton.<br />

perceptions directly to the virtual<br />

environment and allowing direct<br />

control through thought processes.<br />

This dream, at least, is now close to<br />

fruition. Two years ago, computer<br />

scientists at the Graz Technical University<br />

in Austria showcased versions<br />

of such simple, but popular,<br />

video console games as Pong and<br />

Pacman. Users could control the<br />

games through an array of sensors<br />

attached to a close-fitting cap.<br />

Last April, the team managed to<br />

implant a device containing 1,024<br />

electrodes directly into the motorcortex<br />

of a monkey’s brain – the region<br />

of the cerebral cortex involved<br />

in the planning, control and execution<br />

of voluntary movements. The<br />

animal was taught to play Pong<br />

with a joystick and subsequently<br />

learned to control the game by<br />

brainwaves alone.<br />

Gary Yamamoto, CEO of Finch<br />

Technologies, which focuses on<br />

VR and AR technologies, asks, “Today’s<br />

human-machine interfaces<br />

are woefully behind new advances<br />

in technology. What is the purpose<br />

of all these new, incredible technologies<br />

if there aren’t intuitive and<br />

natural ways for people to interact<br />

with them?”<br />

Finch is looking at how AR and VR<br />

applications can include all current<br />

human-machine interfaces (HMIs),<br />

including BCI, computer vision,<br />

voice solutions, inertial measurement<br />

units (IMU) for finger and<br />

hand tracking, eye tracking<br />

source ©: Stevens Institute of Technology<br />

21


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

source ©: Finch Technologies Ltd<br />

Pointing the Way<br />

The FinchRing is a new kind of wearable<br />

that enables hands-free gesture control<br />

for AV and VR mixed reality.<br />

source ©: Finch Technologies Ltd<br />

and more. Finch’s fusion integrates<br />

third-party technologies with its<br />

own products to move HMI experiences<br />

to the next level and accelerate<br />

the realisation of the Metaverse.<br />

“If we don’t do enough to evolve<br />

human-machine interfaces with<br />

this technology, I fear they may<br />

never reach their full mass-market<br />

potential,” Yamamoto warns. Despite<br />

this, he maintains the company<br />

believes that “sooner than<br />

most expect” we will see a basic<br />

BCI, fused with more conventional<br />

inputs, deliver a broader and more<br />

immersive sensory VR/AR user experience.<br />

Sooner than<br />

most expect,<br />

we will see<br />

a basic BCI.<br />

Gary Yamamoto<br />

Finch Technologies<br />

Technology<br />

will help<br />

humans<br />

elevate their<br />

skills.<br />

Andrea Minonne<br />

IDC Augmented<br />

Humanity Launchpad<br />

source ©: IDC UK Blog<br />

Most significantly in the case of<br />

Musk, the ambition comes with<br />

real misgivings about the growing<br />

power of artificial intelligence and<br />

machine learning and its potential<br />

to at least sideline, if not in fact conquer,<br />

humans. His Neuralink company,<br />

which is working to develop<br />

what it calls a brain-machine interface,<br />

is about levelling that playing<br />

field and giving humans abilities<br />

that will help them compete better<br />

on a planet with billions of connected<br />

things, a growing number<br />

of which are also intelligent.<br />

If anyone is looking for another<br />

reason to pay attention, they can<br />

adopt the IDC view, articulated by<br />

Andrea Minonne, senior research<br />

analyst and co-lead of the Augmented<br />

Humanity Launchpad at<br />

the firm’s UK offices: "Augmented<br />

humanity is the advocate of cultural<br />

change across the commercial<br />

and consumer segments,” he says.<br />

"Promoting an AH-oriented culture<br />

and complementing human skills<br />

with technology will help humans<br />

elevate their skills, automate business<br />

processes or domestic chores,<br />

unlock new capabilities, bring disruption,<br />

promote workforce transformation,<br />

and enable humanised<br />

customer experiences."<br />

Could much the same be said for<br />

BCI itself?<br />

Navigating the Metaverse<br />

Human-machine interfaces<br />

(HMIs) could empower users to<br />

compete with technology in an<br />

interconnected world.<br />

What’s the Point?<br />

While Finch focuses on fun and the<br />

researchers at CWRU and at Stevens<br />

Institute are keen on restoring capabilities<br />

to those with disabilities,<br />

other visionaries, such as billionaire<br />

Musk, are aiming even higher and<br />

have suggested a future in which<br />

our thoughts and desires are also<br />

communicable and actionable<br />

through technology.<br />

22


RENESAS WINNING COMBINATIONS<br />

Combine to Design Faster<br />

The unbeatable combination of Renesas + Dialog delivers comprehensive reference<br />

design solutions from our system architects and FAEs.<br />

These compelling product combinations are starting points to accelerate<br />

designs and get to market faster.<br />

Visit renesas.com/win for all the details on 250+ solutions<br />

to jumpstart your next design today<br />

© <strong>2022</strong> Renesas Electronics America Inc. (REA). All rights reserved. All trademarks are the property of their respective owners.


<strong>Smart</strong> Business Metaverse<br />

Metaverse<br />

No Time for<br />

Fun and Games<br />

For years, the great virtual reality (VR) breakthrough has been expected<br />

but it looks as though it didn’t even happen during the pandemic – at least,<br />

not in the private sector. But the technology is becoming<br />

a great success within many industrial companies.<br />

n By Rainer Claaßen<br />

24


Whether it’s Sony PlayStation<br />

VR, Google Glass<br />

or cardboard mounts<br />

that can turn any<br />

smartphone into a virtual reality (VR)<br />

machine, none of these products has<br />

brought the promised commercial<br />

breakthrough. In fact, some products<br />

appear to have stalled completely.<br />

Though one might conclude from<br />

this that the high hopes many had<br />

in these technologies have been<br />

dashed, it isn’t necessarily so, because<br />

new technologies often reach<br />

the mainstream in unexpected ways.<br />

The pandemic has wrought a change<br />

and VR is finding new applications in<br />

business. No longer restricted to a<br />

few lighthouse projects from huge<br />

companies, the technology has become<br />

more versatile, less expensive<br />

and much easier to access and many<br />

companies have started using VR<br />

and will expand its uses in the years<br />

to come.<br />

In a virtual reality simulation, users<br />

move around in an artificial world,<br />

largely disconnected from reality,<br />

with the help of technical tools. The<br />

immersion is most convincing when<br />

VR headsets are used. They are not<br />

absolutely necessary, because a lot<br />

of content can also be played back<br />

on a smartphone or tablet. These<br />

viewers become a window into an<br />

artificial world. Virtual reality differs<br />

from augmented reality (AR) where<br />

additional information or media is<br />

blended with a real-world, camerasourced<br />

image.<br />

Artificial Worlds<br />

There are two basic ways in which VR<br />

experiences can be produced: by developing<br />

a virtual world in software<br />

from scratch or photographically.<br />

Programming an environment can<br />

be time consuming and expensive<br />

but taking photos and videos that<br />

capture an all-round view offers a<br />

quicker and easier solution. Cameras<br />

like the Ricoh Theta or the Insta 360<br />

are available for just a few hundred<br />

euros, deliver surprisingly good<br />

quality and are almost as easy to operate<br />

as conventional cameras.<br />

A typical application scenario is in in-<br />

source ©: De:central Days<br />

Playing it Serious<br />

It’s no secret that many professional soccer players<br />

are also keen users of game consoles. They are<br />

using VR technology to get better training and many<br />

premier league clubs are choosing tools from sports<br />

technology company Rezzil.<br />

Rezzil’s system allows professional players to hone<br />

different skills, especially headers. Heading a ball is<br />

a health risk, so it is often avoided in training. Being<br />

dustrial workplaces where complex<br />

processes need to be permanently<br />

in operation. Until now, they have<br />

usually been shut down, or run at<br />

reduced speed, to train new employees.<br />

The time spent on this familiarisation<br />

can be drastically reduced<br />

with the help of VR.<br />

Companies can<br />

now create VR<br />

applications very<br />

quickly without<br />

the need for<br />

external support.<br />

Sara Boss<br />

Head of Sales at VRdirect<br />

able to practice without any danger gives teams a<br />

big advantage on match day.<br />

In addition, with full-body tracking and methods to<br />

analyse cognitive characteristics, like scanning, decision<br />

making and pressure coping, the technology<br />

helps to improve their general gameplay. It can also<br />

be useful in injury rehabilitation when training on the<br />

field is not possible.<br />

Virtual Training<br />

VR technology can help<br />

professional soccer<br />

players hone their skills,<br />

for instance headers,<br />

without risk of injury.<br />

Sara Boss, head of sales at VRdirect,<br />

explains, "Without having to spend<br />

a large budget on it, companies can<br />

now create VR applications themselves<br />

very quickly and without the<br />

need for external support. This option<br />

is often used for training purposes<br />

in particular."<br />

The background for the experience<br />

is a video or photo shot from the<br />

perspective of an employee at the<br />

workspace. A trainee can use this to<br />

get an overview of the entire environment<br />

without having to actually<br />

enter the workplace.<br />

"The ability to give people an authentic<br />

impression of a workplace<br />

without much effort is already enormously<br />

helpful. This effect is further<br />

enhanced by the inclusion of additional<br />

media content," says Boss.<br />

VRDirect offers a platform through<br />

which companies can access the<br />

virtual infrastructure. Any file<br />

25<br />

source ©: Rezzil, Google LLC


<strong>Smart</strong> Business Metaverse<br />

photo ©: Amazon.com<br />

photo ©: BNP Paribas<br />

Meta What?<br />

It seems like everybody is<br />

talking about the metaverse as<br />

the next big thing that's going<br />

to revolutionise our online lives.<br />

But everyone seems to have<br />

their own idea of what the<br />

metaverse is.<br />

The term originated in the<br />

cyberpunk novel Snow Crash<br />

by Neal Stephenson in 1992. In<br />

it, everyone in the world shares<br />

an ‘imaginary place’ made<br />

available to the public over a<br />

worldwide fiber-optic network<br />

and projected through virtual<br />

reality goggles.<br />

Online communities have existed since at least the mid-1980s but the<br />

metaverse could bring a whole new dimension. Imagine it as being a<br />

virtual world which incorporates augmented reality, virtual reality, 3D<br />

holographic avatars, video and other media. As the metaverse expands,<br />

it will offer a hyper-real alternative world in which people coexist.<br />

Fans of the metaverse envision its users working, playing and staying<br />

connected with friends through everything from online concerts and<br />

conferences to virtual trips around the world.<br />

Interest in pure digital ownership – and the technology that proponents<br />

believe can ensure the security of persistent virtual experiences – has<br />

spiked dramatically, with non-fungible tokens (NFTs) and cryptocurrencies<br />

making the headlines. Virtual productivity platforms are growing,<br />

too, with Facebook and Microsoft announcing new ways to collaborate<br />

online. Nike is even preparing to sell virtual sneakers and has filed<br />

patents to this effect.<br />

In a recent interview with Time magazine, John Egan, CEO of L’Atelier<br />

BNP Paribas, said, “This metaverse<br />

concept gives us the opportunity<br />

to create any universe<br />

that we’ve ever imagined.”<br />

For now, spending any part of<br />

a workday in the metaverse still<br />

seems like a far-off dream for<br />

most of the global workforce,<br />

with many remaining unconvinced.<br />

For them, the memories<br />

John Egan<br />

CEO of L’Atelier BNP Paribas of the first virtual world, Second<br />

Life, may still be too fresh.<br />

Second Life is a real-time, immersive social space for people to interact<br />

through anonymous avatars. Launched by Linden Labs in 1999, in its<br />

heyday it boasted a currency of its own, Linden Dollars, and largely<br />

financed itself through the sale of rentals for virtual properties and the<br />

income from premium memberships. In 2013, the system had around<br />

36 million registered user accounts but a series of scandals, including<br />

the rape of virtual children, caused user numbers to plummet and<br />

Second Life is now often derisively referred to as the "avatar graveyard”.<br />

26<br />

that can be included in a PowerPoint<br />

presentation can also be integrated<br />

into the VR environment. For example,<br />

graphics or videos can be used<br />

to clearly show the necessary work<br />

steps. Artificial worlds can also be<br />

generated by importing computeraided<br />

design (CAD) plans instead<br />

of real-world images. Rather than<br />

redrawing the 3D environment, the<br />

relevant data is often available from<br />

the original manufacturers and architects.<br />

Thanks to standardised<br />

interfaces, more companies are finding<br />

it easier to go down this route.<br />

Choose Your Reality<br />

Until recently, high-performance<br />

computers connected to playback<br />

devices were needed to display vivid<br />

VR experiences. Now, several manu-<br />

Windows to the<br />

Virtual World<br />

Several manufacturers<br />

offer standalone<br />

products through<br />

which VR experiences<br />

can be played<br />

back with excellent<br />

quality.<br />

facturers offer standalone products<br />

through which VR experiences can<br />

be played back with excellent quality.<br />

Besides the Oculus headset from<br />

Facebook, HTC’s Vive and Pico’s visor<br />

are particularly worth mentioning<br />

here. All of them offer technically<br />

mature and well-equipped devices<br />

for just a few hundred euros – and<br />

there are specially tailored packages<br />

for companies.<br />

Companies are benefiting from VR in<br />

a variety of ways. Automotive giant<br />

BMW, for example, used the technology<br />

to let customers participate in a<br />

Virtual Showrooms<br />

Automakers are using VR to<br />

allow customers to participate<br />

in live events without leaving<br />

their homes or offices.<br />

source ©: Actualités télécoms et high-tech, Amazon.de, Pico Interactive<br />

source ©: BMW AG, BMW M GmbH


joint event at the BMW i Motorsport<br />

Virtual Garage Experience. Regardless<br />

of pandemic constraints, attendance<br />

through the use of Pico VR<br />

headsets deeply impressed the virtual<br />

delegates.<br />

VR has also enabled telecom company<br />

Orange Polska to train over<br />

1,000 employees. The average learning<br />

time decreased from four hours<br />

to 45 minutes and effectiveness<br />

increased. Almost 70 percent of the<br />

trainees now think that traditional<br />

teaching should be replaced by VR<br />

training in the future.<br />

Shortly before Mark Zuckerberg announced<br />

a bright future for VR and<br />

renamed his company Meta, Facebook’s<br />

consumer-market Oculus<br />

headsets also expanded into the<br />

business arena. Its Horizon Workrooms<br />

app has been designed to let<br />

people work together in the same<br />

virtual room from anywhere in the<br />

world.<br />

One particularly impressive use case<br />

comes from BSH Hausgeräte, a joint<br />

home appliance and digital services<br />

venture between Bosch, Siemens<br />

and Neff, which has integrated<br />

We can now<br />

experience the<br />

use of tools with<br />

colleagues from<br />

different factories<br />

virtually.<br />

Juan Luis Cihuelo<br />

BSH coordinator<br />

source ©: BSH Hausgeräte GmbH<br />

Zuckerberg is betting big on virtual reality<br />

To the Metaverse<br />

and Beyond n By Eric Doyle<br />

Mark Zuckerberg plans to help<br />

build the ‘metaverse’, an ambitious<br />

three-dimensional world that will<br />

merge real life with a virtual reality<br />

existence in an unlimited universe<br />

of playgrounds. He predicts that the<br />

metaverse will supplant the internet<br />

with the bold promise that “you’re<br />

going to be able to do almost anything<br />

you can imagine”.<br />

As CEO of the company, he announced<br />

last October that Facebook,<br />

the umbrella company that includes<br />

the social media giant alongside<br />

Instagram and WhatsApp, will be<br />

renamed Meta to underscore the<br />

importance of the initiative. During<br />

the presentation, he outlined some<br />

of the experiences that users will be<br />

able to enjoy: competing against holograms<br />

of Olympic athletes or going<br />

to virtual concerts with your friends.<br />

In the business world, there will be<br />

mixed-reality meetings where some<br />

participants are physically present<br />

while others beam in from the metaverse<br />

as avatars, cartoon-like images<br />

of themselves.<br />

You're going to<br />

be able to do<br />

almost everything<br />

you can<br />

imagine.<br />

Mark Zuckerberg<br />

CEO of Meta/Facebook<br />

source ©: Facebook / Mark Zuckerberg<br />

The metaverse is no more than a<br />

concept at the moment and potential<br />

partners like Meta, Microsoft,<br />

Apple and Nvidia have yet to discuss<br />

plumbing issues, such as technical<br />

standards and, further down the<br />

line, how much compute power will<br />

be required and its environmental<br />

impact. There are also moral issues<br />

to be considered in the light of the<br />

recent Facebook Papers revelations<br />

about the company’s apparent reluctance<br />

to take action against bullying<br />

and misinformation on its current<br />

platform.<br />

It may be some time before the metaverse<br />

virtually becomes a reality. In<br />

the meantime, the press is likely to<br />

be overpopulated with articles discussing<br />

its possibilities and benefits,<br />

its limitations and negative impacts.<br />

That it will happen in some form or<br />

other is beyond question because the<br />

3D virtual world is too attractive and a<br />

future reality akin to USS Enterprise’s<br />

Holodeck in Star Trek is beguiling.<br />

27


<strong>Smart</strong> Business Metaverse<br />

Interview<br />

source ©: Advantech Service-IoT GmbH<br />

Intuitive Experience<br />

An interview with June Hsieh, senior<br />

B2B sales manager at HTC Vive,<br />

about the impact of VR in business<br />

environments.<br />

VR makes<br />

training larger<br />

groups during<br />

the pandemic<br />

much easier.<br />

June Hsieh<br />

HTC Vive<br />

Do you have the impression that<br />

VR technology in companies received<br />

a boost from the pandemic?<br />

Companies like VW have been using<br />

VR in training since 2016. In an<br />

environment where production<br />

processes are constantly being optimised,<br />

it is extremely difficult to<br />

teach employees new procedures<br />

under pandemic conditions. Training<br />

larger groups is, after all, hardly<br />

possible in the company. VR applications<br />

make this much easier. In<br />

our case, the significant increase in<br />

sales of the goggles already shows<br />

that companies are using the technology<br />

intensively.<br />

Are there any areas where VR<br />

works particularly well?<br />

Many customers use VR technology<br />

for training and to familiarise<br />

new employees – but there's also a<br />

lot happening in the planning area.<br />

Service providers such as Halocline<br />

make it easier for companies that<br />

have no previous experience in this<br />

area to get started.<br />

Isn't learning to use headsets and<br />

the programming process very<br />

time-consuming both for companies<br />

and employees?<br />

Over time, the application has become<br />

quite intuitive. Of course, you<br />

need some time to get used to the<br />

VR experience but those who get<br />

into it quickly, soon get to grips<br />

with it. Producing VR content has<br />

also become much easier lately.<br />

Many newcomers are surprised at<br />

how easy integration has become.<br />

virtual reality as a commonly used<br />

tool throughout its factories. VR has<br />

allowed BSH to reduce the time and<br />

costs for developing new production<br />

lines by accelerating the engineering<br />

processes.<br />

"Finding ourselves in the same virtual<br />

room with suppliers, colleagues<br />

and the production machines, we<br />

are able to review and release new<br />

designs, " explains Juan Luis Cihuelo,<br />

BSH coordinator in the Zaragoza<br />

plant in Spain.<br />

Staying Healthy<br />

During lockdown, the technology<br />

also helped to safeguard the health<br />

of staff while keeping production<br />

lines running. "We could experience<br />

the material supply and the use of<br />

tools with colleagues from different<br />

factories virtually," he adds. This<br />

large utilisation of VR tools required<br />

less effort than previous projects.<br />

"In the past, we were focused on<br />

highly sophisticated and expensive<br />

IT tools for digital factory planning<br />

and the specialists required to use<br />

these tools, like VR Caves,” says Ralf<br />

Just Another Day<br />

at the Office<br />

VR will become part<br />

of everyday life in the<br />

business environment<br />

much sooner than<br />

in private life, some<br />

experts predict.<br />

Nagel, product owner for the <strong>Industry</strong><br />

4.0 digital factory at BSH. A Cave,<br />

which stands for a Cave Automatic<br />

Virtual Environment, is an immersive<br />

VR environment where projectors<br />

are directed at between three and<br />

six of the walls of a room-sized cube.<br />

“However, to be successful in digitalisation,”<br />

he continues, “it is necessary<br />

to focus on the people, the<br />

cultural change and the scalability<br />

of the solutions. For us, this means<br />

that every engineer worldwide can<br />

use VR technology for planning and<br />

engineering in daily work and benefit<br />

from its integration into our digital<br />

factory backbone and the global<br />

digital collaboration."<br />

There is an increasing number of<br />

indicators that VR technologies will<br />

become part of everyday life in the<br />

business environment more quickly<br />

than in private life. It makes work<br />

easier, saves money and creates new<br />

opportunities for collaboration. It<br />

also helps people across continents<br />

to work together more efficiently<br />

and more quickly.<br />

source ©: Meta<br />

28


E-Mobility<br />

think again about<br />

vehicle ownership<br />

The wholesale electrification of<br />

transportation systems will be a<br />

key element of ongoing efforts<br />

to reduce carbon emissions and<br />

tackle the climate change challenges that<br />

our society is now facing. It will also be<br />

pivotal in addressing the air pollution issues<br />

that are currently being experienced in densely<br />

populated urban areas.<br />

Electric vehicle (EV) sales have reached new<br />

heights over the course of the last 18 months, with<br />

EU data showing that they now represent approximately<br />

11% of all new car registrations. It is clear that<br />

the numbers are going to increase still further in the<br />

coming years, with the EU’s target for EVs to constitute<br />

well over half of vehicle registrations in member<br />

states by the end of this decade. Likewise, major investment<br />

in rail networks has resulted in a migration<br />

away from diesel-based trains to ones that rely on<br />

electrical propulsion - with clear environmental and<br />

public health benefits consequently being derived.<br />

The deployment of extensive charging stations is<br />

essential if continued uptake of EVs is going to be<br />

encouraged - and this will be an integral part of<br />

many of the smart city projects that are currently<br />

being planned across Europe. Much of the earlier<br />

equipment that had initially been used is now in the<br />

process of being replaced by higher voltage rapid<br />

chargers. These will offer greater convenience to<br />

vehicle drivers, as the recharge times supported are<br />

cut from several hours to less than 30 minutes, closer<br />

to the length of a fuel-pump visit. At the same time,<br />

high-power wallbox charging units are starting to<br />

be installed within the residential environment.<br />

Raising the voltage levels of EV powertrains will be<br />

another important step in driving more widespread<br />

EVs are the<br />

fastest growing<br />

subsegment in<br />

the automotive<br />

IC market.<br />

Gilles Beltran<br />

President Avnet Silica<br />

adoption of these vehicles. This will<br />

mean that efficiency figures can be<br />

boosted and their overall weight reduced.<br />

The key benefit of all this will<br />

be that far longer distances may be<br />

covered between recharges, giving the<br />

public greater confidence that buying an<br />

EV is the right decision.<br />

The EV era may also lead to established views<br />

on vehicle ownership, which have remained the<br />

same for over a century, being re-evaluated. Instead<br />

of simply buying cars, mobility-as-a-service business<br />

models might start to be explored. Connection of<br />

EVs to the electrical distribution network will also<br />

present homeowners with financial incentives to<br />

participate in grid-balancing activities.<br />

This large-scale transport electrification is bringing<br />

unprecedented demands for semiconductor components.<br />

EVs are the fastest growing subsegment<br />

in the automotive IC market, increasing by approximately<br />

68 percent during 2021 with a further 25 percent<br />

growth expected in <strong>2022</strong> * . EV powertrains and<br />

rail infrastructure will require access to advanced<br />

semiconductor technology, including the latest<br />

wide bandgap discretes. As well as state-of-the-art<br />

power devices, commercial fast charging stations<br />

will mandate next generation data connectivity and<br />

superior security solutions. Robust and responsive<br />

supply chains must therefore be in place, so as to<br />

ensure that shipment schedules can be maintained.<br />

The engineering team at Avnet Silica has a deep<br />

understanding of the dynamics involved in transport<br />

electrification and their logistical implications.<br />

This means that our operations are fully prepared to<br />

ramp up in procurement activity that is on the horizon.<br />

* Avnet TAM analysis<br />

29


<strong>Smart</strong> Business IoT & Regulation<br />

IoT & Regulation<br />

The Future of IoT<br />

The Internet of Things (IoT) is poised<br />

to disrupt and transform many<br />

industries. While IoT is still in its<br />

infancy, businesses are already<br />

experiencing improved operational<br />

efficiencies, productivity growth,<br />

cost reductions and new revenue<br />

generation opportunities. These<br />

gains are likely to increase and scale<br />

across the economy as IoT technological<br />

maturity and adoption increaes.<br />

n By Gordon Feller*<br />

Emerging technologies, such as<br />

IoT, can take ten or more years<br />

to reach market saturation<br />

from incubation. The US federal<br />

government stimulates this journey<br />

through targeted investments<br />

in research and development (R&D)<br />

and technology transfer as part of its<br />

Lab-to-Market process. In 2020, the<br />

US government invested $140 billion<br />

in a broad range of federally-funded<br />

R&D programmes, including emerging<br />

technologies. Approximately<br />

$50 billion of this total was directed<br />

towards nearly 300 government<br />

owned, government operated laboratories<br />

across the country. Some of<br />

these investments will likely yield<br />

extraordinary, long‐term, economic<br />

impacts when they are transferred<br />

to and used by industry.<br />

IoT is now ranked as strategically<br />

important by each of the major<br />

US federal agencies that focus on<br />

increasing competitiveness, economic<br />

prosperity, and national<br />

security.<br />

For IoT to realise its potential and<br />

achieve these benefits, a robust<br />

and secure technology infrastructure<br />

is required. This requires addressing<br />

two fundamental questions<br />

to ensure that resources are<br />

effectively allocated:<br />

• Where are the technology infrastructure<br />

gaps that prevent IoT<br />

technologies from being more<br />

widely adopted?<br />

• Where should the US federal<br />

government be directing resources<br />

and investments to<br />

close these gaps?<br />

30<br />

*Gordon Feller has been reporting on emerging tech trends for over 40 years. He served as Global Fellow at the Smithsonian Institution<br />

and founded the non-profit Meeting of the Minds. He’s been awarded several fellowships, including the Abe Fellowship.


NIST Steps Up<br />

The National Institute of Standards<br />

and Technology (NIST) is a nonregulatory<br />

agency within the US<br />

Department of Commerce. Its role<br />

is to promote technology innovation,<br />

competitiveness and the<br />

commercialisation of federallysponsored<br />

research across all government<br />

agencies. NIST is central<br />

to the Lab-to-Market efforts, serving<br />

as the coordinator of the President's<br />

Management Agenda Cross<br />

Agency Priority Goal 14 (Lab-to-<br />

Market) and co-chairing a National<br />

Science and Technology Council<br />

(NSTC).<br />

"Given the strategic importance of<br />

IoT, and in support of the Lab-to-<br />

Market initiative, NIST felt that it<br />

needed to better understand the<br />

source ©: National Science Foundation<br />

NIST wants to<br />

better understand<br />

the current<br />

state of IoT<br />

research efforts.<br />

Sethuraman<br />

Panchanathan<br />

Director of National Science<br />

Foundation<br />

current state of IoT research efforts,"<br />

says Sethuraman Panchanathan,<br />

Director of National Science<br />

Foundation and co-chair of NTSC's<br />

Committee on Science and Technology<br />

Enterprise. To answer the<br />

two fundamental questions, he<br />

says, NIST has funded a research<br />

grant aimed at four key goals:<br />

• To better understand the current<br />

state of IoT research efforts.<br />

• To assess the top technology infrastructure<br />

gaps.<br />

• To quantify the benefits of closing<br />

those gaps.<br />

• To identify where future federal<br />

research investments should be<br />

made, whether it be in targeted<br />

research investments, stimulating<br />

private sector investment<br />

incentives, or other methods.<br />

This new in-depth analysis is already<br />

helping NIST to address<br />

some of the pressing IoT-related<br />

challenges by becoming better<br />

informed about the necessary<br />

31


<strong>Smart</strong> Business IoT & Regulation<br />

steps, future programmes, and the<br />

smart initiatives and investments<br />

which can support long-term economic<br />

outcomes.<br />

A California-based company,<br />

Strategy of Things, was awarded<br />

the NIST grant to conduct this research<br />

study. The research team<br />

is examining IoT opportunities in<br />

ten key industries, which together<br />

represent a significant portion of<br />

the US economy:<br />

Agriculture<br />

Construction<br />

Energy/Utilities<br />

Financial Services<br />

Healthcare<br />

Manufacturing<br />

Retail<br />

Public Sector<br />

• Telecommunications<br />

Transport<br />

Benson Chan, a senior partner<br />

at Strategy of Things, serves on<br />

the team of experts, assisted by a<br />

network of partners from government<br />

and the private sector, to ensure<br />

that the research project truly<br />

assists key leaders.<br />

The government<br />

wants to work<br />

on gaps in the<br />

technology<br />

infrastructure.<br />

Benson Chan<br />

senior partner at<br />

Strategy of Things<br />

Step by Step to IoT<br />

Initial findings from NIST<br />

predict that the evolution<br />

of IoT will occur in<br />

four distinct phases,<br />

each building on the<br />

infrastructure, capabilities,<br />

solution maturity<br />

and market adoption of<br />

the previous one.<br />

Chan argues that “IoT technologies<br />

bring enormous disruptive<br />

and beneficial impacts to national<br />

security, economic prosperity,<br />

human safety and well-being.<br />

But a number of technology infrastructure<br />

barriers stand in the<br />

way”. Because of this, he concludes<br />

that “while a number of<br />

established and start-up companies<br />

are developing IoT solutions,<br />

the federal government<br />

source ©: Benson Chan / Private Photo<br />

wants to work on the technology<br />

infrastructure gaps that industry<br />

is looking at. These include those<br />

that are not yet market ready, as<br />

well as those that no one company<br />

has the interest or resources<br />

to develop.”<br />

IoT’s Development Phases<br />

While the research is ongoing and<br />

won’t be completed until early<br />

<strong>2022</strong>, initial findings predict that<br />

the evolution of IoT will occur<br />

in four distinct phases (see Figure<br />

One). Each successive stage<br />

builds on the infrastructure, capabilities,<br />

solution maturity and<br />

market adoption of the previous<br />

one.<br />

Today’s best-of-breed IoT applications<br />

are largely point solutions<br />

that address operational<br />

inefficiencies and productivity.<br />

As underlying technologies mature<br />

and as customer acceptance<br />

grows, future IoT applications are<br />

becoming increasingly more sophisticated.<br />

They are being tightly<br />

integrated with operations and<br />

The IoT Journey: Operational Efficiency<br />

Full Autonomy<br />

Sensorization<br />

Connected Devices<br />

Vendor Ecosystems<br />

Sensor / Actuator Densif ication<br />

Massively connected devices and system of systems<br />

<strong>Industry</strong> and extended ecosystems<br />

Analytics / Machine Learning<br />

Artificial Intelligence<br />

Ambient Intelligence<br />

Ubiquitous connectivity and computing<br />

New Business and Operation Models<br />

Policies and regulations<br />

Secure and Private<br />

Trusted<br />

Ethical<br />

source ©: Strategy of Things<br />

32


The IoT Journey: Operational Efficiency<br />

Full Autonomy<br />

Edge Devices and Gateways – Processing capability, power efficiency, power management<br />

Distributed architectures – edge, mobile edge, cloud; interoperable system of systems<br />

Artifical and ambient Intelligence – autonomous intelligence, distributed collaborative<br />

intelligence<br />

Trust Architectures and Models (security, privacy, distributed ledger technology)<br />

Communications and networks at scale<br />

(stability, availability, reliability, context and date aware, etc.)<br />

Data Models, Marketplaces, Ecosystems<br />

Ethical algorithms and governance<br />

Interoperability and standards<br />

source ©: Strategy of Things<br />

information technology systems,<br />

and with each other. In short,<br />

these future IoT applications will<br />

become part of a larger, automated<br />

system of systems. The<br />

emerging solutions are focused<br />

on enabling fully-automated operations<br />

across industry ecosystems<br />

and they promise to yield<br />

transformative benefits that can<br />

only be envisioned today.<br />

The drivers of IoT evolution do<br />

differ at each stage of the evolutionary<br />

process. For instance, today’s<br />

IoT applications use a small<br />

number of sensors. The data collected<br />

from these sensors is aggregated<br />

and analysed largely<br />

through machine learning. IoT<br />

vendors expand the functionality<br />

and utility of their solutions by<br />

building and operating their own<br />

ecosystems to create an end-toend<br />

system.<br />

IoT evolution is being driven by<br />

technological advancements, interoperability<br />

across industries,<br />

government policies and regulations,<br />

and scale. Ten sensors in a<br />

factory today will soon become<br />

tens or hundreds of thousands.<br />

In these upcoming systems of<br />

systems, machine learning will be<br />

replaced by ambient intelligence,<br />

where all devices can interact with<br />

each other autonomously and intelligently.<br />

With this integration,<br />

cybersecurity evolves to a broader<br />

concept of trust which encompasses<br />

not only the integrity of<br />

the data, the connections and the<br />

devices but also the decisions, the<br />

reliability and availability, and the<br />

equity of the outcomes.<br />

To facilitate the future state of IoT,<br />

the research has identified some<br />

potential areas of technological<br />

research investment (see Figure<br />

Two). These were identified based<br />

on a study of the IoT accelerators<br />

shown in Figure One. While there<br />

is some research on these topics<br />

today, it is largely done independently<br />

in a few areas. A broader<br />

and more coordinated research<br />

agenda is required to accelerate<br />

the maturity and adoption of IoT<br />

within the US.<br />

Where to Invest?<br />

To enable the future<br />

state of IoT, research<br />

from NIST has highlighted<br />

a number of<br />

potential key areas<br />

for future technology<br />

research investment.<br />

IoT is a disruptive and transformational<br />

emerging technology. For it to<br />

realise its full potential, governments<br />

must understand the substantial<br />

economic, strategic and national security<br />

implications of IoT better. The<br />

significance of IoT’s development is<br />

too important to be left to organic<br />

evolution or to chance alone. The<br />

US federal government, through<br />

its R&D investments and policy development,<br />

needs to play a critical<br />

role in accelerating the maturity and<br />

adoption of IoT. The wide-ranging<br />

study process, as convened by NIST<br />

and as implemented by Strategy of<br />

Things, is already helping to bring<br />

key stakeholders together.<br />

Next Steps<br />

The next stage of this effort is being<br />

focused on offering a portfolio<br />

of opportunities for action. These<br />

moves can not only be taken by<br />

any one of a myriad of government<br />

agencies but also by a growing<br />

network of committed technology<br />

partners: private companies, universities,<br />

foundations, associations.<br />

33


<strong>Smart</strong> Business Interview: Lou Lutostanski<br />

source ©: Avnet Silica<br />

Why should someone look to a<br />

distributor like Avnet for information<br />

about IoT?<br />

Throughout our history, Avnet has<br />

been the provider of enabling technologies<br />

for OEMs of electronic<br />

devices. Supporting the Internet<br />

of Things is a natural progression<br />

of our business, and we are positioned<br />

to support this transformation<br />

of delivering insights through<br />

connected devices. We recognise<br />

that our OEM customers who build<br />

“The Things” in “IoT” (the Internet<br />

of Things”) will face significant skill<br />

and resource challenges as market<br />

demands are requiring them to add<br />

cloud-based features and connected<br />

experiences to their traditional<br />

products. IoT implementations are<br />

complex and span many different<br />

disciplines that require a significant<br />

number of software skills that were<br />

not needed in the past. Recognising<br />

this gap, Avnet has invested<br />

significant resources in acquiring<br />

and developing IoT Software capabilities<br />

that can help our OEM<br />

customers create these connected<br />

experiences using the principles of<br />

We're trying<br />

to build<br />

security<br />

options into<br />

IoTConnect,<br />

so implementing<br />

the<br />

desired level<br />

of security is<br />

as easy as<br />

checking a<br />

box to order<br />

fries with<br />

your burger.<br />

Lou Lutostanski<br />

Vice President for IoT<br />

at Avnet<br />

IoT. We are prepared to support IoT,<br />

and over the past three years, we<br />

have built a solid practice and added<br />

over 700 IoT and Cloud software<br />

developers to an already significant<br />

number of hardware engineers.<br />

And we will continue to evolve so<br />

that we maintain our position as a<br />

significant technology enablement<br />

partner to our customers.<br />

Seems to me that every time<br />

someone does a new IoT project<br />

they reinvent the wheel. Is that really<br />

necessary?<br />

No, it is not. While there will always<br />

be some level of customisation in<br />

bespoke IoT applications, many<br />

companies continue to spend the<br />

majority of their time and money<br />

building and maintaining their<br />

own IoT platform using open<br />

source or Hyperscale Cloud IoT<br />

Services. This significantly extends<br />

their time to market and robs them<br />

of the resources that would be<br />

better spent on providing differentiated<br />

value in the way of their<br />

applications. It also creates significant<br />

overhead to maintain the IoT<br />

platform, which in the end, their<br />

customers will pay for.<br />

Other companies hire system integrators<br />

to build a custom IoT platform.<br />

Again, it delays time to market,<br />

incurs great expense, and locks<br />

them to one company (the SI) who<br />

they will be reliant on for the lifetime<br />

of the application as their IoT<br />

platform must be maintained into<br />

perpetuity.<br />

Spending time building or having<br />

someone else build an IoT platform<br />

for companies that create value<br />

through applications and IoT implementations,<br />

is a waste of time and<br />

money. And it adds zero value to<br />

their end customer.<br />

This is the number one reason why<br />

IoT is not scaling, and in turn, not<br />

reaching the forecast in connections<br />

predicted several years ago.<br />

Talking of ecosystems, you once<br />

criticised what you called 'ecosystem<br />

mass confusion'. How should<br />

customers go about selecting an<br />

ecosystem?<br />

Ask yourself, what would be the<br />

state of the mobile phone industry<br />

34


Interview<br />

Making<br />

‘Things’ Easier<br />

The world of IoT is changing fast and the number<br />

of vendors and solutions are legion. Finding the right<br />

supplier can be tricky, says Lou Lutostanski,<br />

vice president for the Internet of Things at Avnet.<br />

He was named IoT Leader of the Year at Industrial IoT<br />

World in 2019. Lutostanski talked with <strong>Smart</strong> <strong>Industry</strong><br />

editor Tim Cole about the future of IoT.<br />

n By Tim Cole<br />

potential return on their investment.<br />

And in the case of IoT, the<br />

higher the potential ROI, the richer<br />

the applications, AI algorithms, and<br />

hardware purpose built for the solution.<br />

The bottom line is, customers today<br />

should look for an ecosystem that<br />

can invest the most in research and<br />

development and yield the optimal<br />

features because they integrate<br />

into an IoT platform that is based<br />

on HyperScale Cloud IoT Services<br />

that can be used horizontally across<br />

many or all IoT solutions. In this<br />

way, the application that they buy<br />

will not require them to bear a part<br />

of the substantial additional cost<br />

of maintaining the platform. That<br />

cost will be born by the thousands<br />

and tens of thousands of customers<br />

that buy various applications built<br />

on that IoT platform. Additionally,<br />

it will prevent lock-in of one or several<br />

vendors and give them the<br />

if there were hundreds of operating<br />

systems rather than the few<br />

available today. What would be<br />

the quality and usefulness of user<br />

applications if every manufacturer<br />

wrote their own operating system?<br />

Fortunately, this industry gravitated<br />

towards just two OS providers,<br />

which has enabled a massive<br />

ecosystem supporting developers<br />

and markets for applications.<br />

In comparison, ecosystems for IoT<br />

developers and users are not at<br />

this level of maturity, and there is<br />

a lot of confusion around identifying<br />

the ecosystem that is going to<br />

provide the solid foundation for<br />

this industry.<br />

IoT ecosystems form around IoT<br />

platforms. These platforms provide<br />

the rules and structure for the<br />

various partners to integrate their<br />

products and services in a manner<br />

that is compatible with all other<br />

partners required for a successful<br />

IoT implementation.<br />

Partners who add value within any<br />

ecosystem are attracted by the<br />

popularity of a platform. The fewer<br />

platforms available, the higher the<br />

Build & Deploy<br />

IoTConnect Platform is a smart<br />

IoT platform that<br />

helps boost efficiency,<br />

manage assets and<br />

adopt innovation.<br />

source ©: Avnet<br />

BACnet<br />

IoT Portal<br />

Dashboards<br />

Rule Engine<br />

Analytics on<br />

Gateway<br />

CoAP<br />

Command Execution<br />

SMS<br />

SDK<br />

MQTTS<br />

Protocol<br />

Alerts &<br />

Notification<br />

Push Notification<br />

HTTPS<br />

Email<br />

Data<br />

Engineering<br />

Conection<br />

Bridge<br />

SAP HANA<br />

WS<br />

SAP BI<br />

Machine Learning<br />

Data Streaming<br />

Data Analysis<br />

Salesforce<br />

ERP<br />

AMQP<br />

CAN bus<br />

35


<strong>Smart</strong> Business Interview: Lou Lutostanski<br />

Getting Started<br />

maximum number of vendor choices<br />

for their IoT implementation.<br />

Tell me more about Avnet IoTConnect<br />

which seems to be an interesting<br />

approach.<br />

Avnet’s IoTConnect is an IoT platform<br />

built on Microsoft Azure microservices.<br />

Our microservices architecture<br />

enables us to adapt to<br />

the evolving needs of our users and<br />

developers, and we view Microsoft<br />

as one of two hyperscale cloud providers<br />

who can support Avnet for<br />

the long term. We believe alternative<br />

platform architectures built on<br />

open-source technologies are too<br />

complex to maintain and become<br />

stagnant shortly after their release.<br />

But building from the established<br />

Microsoft Azure ecosystem has provided<br />

a solid foundation.<br />

Based on our deep and long-term<br />

relationships with our semiconductor<br />

suppliers and OEM customers<br />

and our growing capabilities<br />

in cloud, IoT, AI, security, and application<br />

software, we believe our<br />

IoTConnect Platform can serve as<br />

an enabler to allow for simple, fast,<br />

and secure IoT implementations.<br />

And if we are successful in getting<br />

IoTConnect adoption as one of the<br />

two or three standard Horizontal<br />

IoT Platforms, then the scale that<br />

the industry has been expecting<br />

and is now demanding can become<br />

a reality.<br />

It would have been much easier<br />

for Avnet to help our customers<br />

with their IoT implementations,<br />

It's Official!<br />

The W3C has declared<br />

the WoT Architecture<br />

and the WoT<br />

Thing Description to<br />

be official recommendations<br />

for the<br />

standardisation of IoT<br />

applications.<br />

if there were already one or two<br />

established platforms out there.<br />

But there were not. And as such,<br />

the complexity and risk associated<br />

with IoT discouraged our customers<br />

from pursuing strategies that could<br />

create substantial growth in device<br />

counts that would have in turn fueled<br />

growth for our business. The<br />

lack of an established IoT platform<br />

also forced us to help customers<br />

create hardware solutions with<br />

limited use as they were bespoke<br />

to only the IoT platform they were<br />

designed for.<br />

source ©: Avnet<br />

Azure Sphere<br />

development kits<br />

provide everything<br />

you need to begin<br />

prototyping and<br />

developing Azure<br />

Sphere applications.<br />

Sounds like IoTConnect is offering<br />

a type of Plug and Play for IoT.<br />

Plug and Play is a term that I first<br />

heard about in the PC industry.<br />

It applied to PC peripherals that<br />

could plug directly into a PC without<br />

the requirement of the user<br />

being forced to run software programmes<br />

to install drivers.<br />

Plug and Play in the IoT world is<br />

exponentially more complex. The<br />

number of things, software elements,<br />

and connectivity methods<br />

source ©: W3C<br />

36


used to create IoT solutions are infinite.<br />

So creating rules for how these<br />

things interact with each other in<br />

the way of the platform, and having<br />

the software and hardware skills<br />

to assist those connections, is what<br />

makes Avnet the ideal entity to bring<br />

the physical and virtual worlds, the<br />

OT and IT worlds, together.<br />

We believe that Avnet will succeed<br />

while other companies, some much<br />

bigger than Avnet, have failed because<br />

they did not have a deep understanding<br />

of all the parts of IoT.<br />

People with device or connectivity<br />

solutions did not understand the<br />

cloud and above. And the cloud<br />

people lacked the deep embedded<br />

device experience to create a scalable<br />

means for rapidly onboarding<br />

an infinite number of “Things”.<br />

source ©: Informa PLC, Jeremy Coward<br />

You advise bringing order to IoT.<br />

What do you mean by that?<br />

It means developing software rules<br />

that allow companies with many<br />

different types of hardware and<br />

software products and services to<br />

participate in successful IoT implementations,<br />

without having to<br />

understand the complexities of all<br />

the technologies required to produce<br />

them. IoTConnect defines<br />

those software rules and provides<br />

a mechanism to manage those<br />

devices, integrate third party software,<br />

and integrate applications<br />

and AI in a manner that delivers<br />

simple, fast, and secure IoT implementations.<br />

It allows OEMs to deliver<br />

rich features and user experiences<br />

around their products and the<br />

opportunity to create new services<br />

to deliver revenue beyond just the<br />

physical hardware.<br />

Are IoT solution providers really<br />

addressing the security problem<br />

in an adequate fashion?<br />

The majority are not. Security is extremely<br />

complex. And with many<br />

companies building their own IoT<br />

platforms or paying someone to<br />

build it for them, budgets are usually<br />

blown before the complexities<br />

of security can be addressed.<br />

I would make two comments about<br />

IoT security.<br />

• People who are serious about IoT<br />

will never deploy at scale without<br />

some level of security. The financial<br />

liabilities and the potential<br />

damage to their brand are just<br />

too significant.<br />

• For those that deploy without security<br />

by design that get hacked,<br />

the only fix is to start over. (Rip &<br />

Replace).<br />

Avnet has built varying levels of<br />

securities into IoTConnect. And we<br />

are working with third party security<br />

and identity providers to integrate<br />

their IP into IoTConnect to facilitate<br />

the deployment of security<br />

after the fact. So one can preclude<br />

security through small or test deployments<br />

and implement security<br />

at a later date. Avnet’s goal through<br />

IoTConnect is making adding security<br />

to your IoT implantation as easy<br />

as adding fries to your burger order.<br />

How do you scale IoT?<br />

The industry needs to limit the<br />

number of IoT platforms to less<br />

than a handful. This will attract<br />

partners and create a vast and vibrant<br />

ecosystem. Companies need<br />

stop building, or paying someone<br />

to build their own IoT platforms<br />

and build their applications and<br />

Expert Opinion<br />

Lou Lutostanski, Vice<br />

President of IoT at<br />

Avnet, was named<br />

IIoT Leader of the<br />

Year at Industrial IoT<br />

World 2019.<br />

product experiences around one or<br />

two that have wide adoption in the<br />

industry such as the WoT Standard<br />

released by the W3C. Customers<br />

will never accept that they will have<br />

to maintain an equal number of IoT<br />

platforms to the number of applications<br />

that they deploy.<br />

How does the COVID pandemic<br />

accelerate IoT?<br />

I think there are two answers to that<br />

question. One is that most people<br />

are working from home now and<br />

we're finding they appear to be<br />

much more efficient. As such, they<br />

have much more time to think long<br />

term regarding applying IoT technology<br />

in their products or services.<br />

The other thing is that there's a<br />

whole new generation of applications<br />

that have been spawned<br />

for contact tracing, prescreening,<br />

medical monitoring, which have an<br />

urgency about them coupled with<br />

an extreme requirement for action.<br />

This has created a whole new application<br />

category, if you will, built to<br />

deal with the challenges presented<br />

by the Covid pandemic. So, I think<br />

these two factors have accelerated<br />

the deployment of IoT implementations.<br />

37


<strong>Smart</strong> Business Six Hurdles<br />

Six Hurdles<br />

Why IoT<br />

Projects Fail<br />

The number of businesses aiming to leverage IoT solutions is high but so<br />

is the failure rate. Network giant Cisco estimates that 74 percent<br />

of projects fail and the probable cause is a failure to understand<br />

the top obstacles and challenges that often derail IoT deployments.<br />

n By Bryan Witkowski<br />

38<br />

038-041 Why IoT Projects Fail-JC.indd 38 26.04.22 13:10


Increased<br />

Complexity<br />

Increased<br />

Complexity<br />

The explosion in the use of<br />

connected devices has created<br />

a rising need for organisations<br />

to harness data<br />

from them, which, in turn, is driving<br />

businesses to ramp up their<br />

IoT digitisation efforts. Market and<br />

consumer data specialist Statista<br />

reckons there are approximately<br />

21.5 billion interconnected devices<br />

in the world and many businesses<br />

– 94 percent, according to IOT<br />

Signals, a report from the Hypothesis<br />

Group and Microsoft – see<br />

this growth as an opportunity to<br />

analyse data and generate insights<br />

that reduce operational costs, enable<br />

better decision-making and<br />

drive innovation.<br />

Here are some of the most common<br />

hurdles blocking the track to<br />

successful adoption of IoT projects.<br />

Increased complexity – There<br />

can be many challenges around<br />

interoperability between networks,<br />

gateways and devices. A<br />

multi-vendor environment can<br />

include compatibility issues between<br />

different vendors’ products<br />

and systems, especially when<br />

The challenges<br />

may seem<br />

overwhelming,<br />

but there are<br />

many options<br />

available.<br />

Bryan Witkowski<br />

Head of Strategic Planning<br />

and co-founder of MachineQ<br />

source ©: MachineQ<br />

39<br />

038-041 Why IoT Projects Fail-JC.indd 39 26.04.22 13:10


<strong>Smart</strong> Business Six Hurdles<br />

Number of Internet of Things (IoT)<br />

connected devices worldwide from 2019 to 2030, by use case *<br />

30,000<br />

20,000<br />

10,000<br />

7,741<br />

<br />

<br />

<br />

<br />

8,738.8<br />

Connected Vehicles<br />

<strong>Smart</strong> Grit<br />

Consumer Internet & Media Devices<br />

Others<br />

16,436.6<br />

14,759.9<br />

13,146.3<br />

11,570.2<br />

10,065.1<br />

18,148.9<br />

19,908.4<br />

21,721.2<br />

23,570<br />

25,444.5<br />

source ©: Statista<br />

0<br />

2019 2020 * 2021 * <strong>2022</strong> * 2023 * 2024 * 2025 * 2026 * 2027 * 2028 * 2029 * 2030 *<br />

Additional Information: Worldwide; 2019 to 2020<br />

* in millions<br />

some use proprietary technology<br />

that is not based on industry standards.<br />

For example, differences in<br />

authentication and identification<br />

methods may cause access issues<br />

and the use of different protocols<br />

can limit the ability of devices and<br />

systems to ’talk to each other’ and<br />

share information. There are also<br />

challenges related to complexity<br />

of deployment, especially where<br />

there is no access to IT support and<br />

the installation is typically done by<br />

skilled workers who are not technically<br />

savvy. An example of this<br />

would be plumbers doing a water<br />

meter installation.<br />

Limitations to Scale – As IoT<br />

networks grow, some of the challenges<br />

above become even more<br />

pronounced because of additional<br />

devices and systems. As a result,<br />

What are They Doing?<br />

The single largest use<br />

case in terms of number<br />

of Internet of Things<br />

(IoT) connected devices<br />

is consumer internet<br />

and media devices,<br />

accounting for a third<br />

of all devices worldwide<br />

in 2030. The other two<br />

largest use cases are<br />

smart grid (e.g. smart<br />

meters) and connected<br />

vehicles.<br />

the solutions created in one context<br />

may not work well in another,<br />

which could delay or stop an enterprise<br />

IoT project.<br />

Talent Shortages – Similar to the<br />

current IT talent shortage, there is<br />

a lack of available IoT experts to fill<br />

needed positions. This can affect<br />

a range of industries, such as food<br />

services and hospitality, that are<br />

looking to embrace IoT. According<br />

to research from Inmarsat, 46<br />

percent of organisations stated<br />

that skills shortages are the most<br />

significant barrier to their deployments.<br />

A lack of qualified, skilled<br />

talent can affect the ability to roll<br />

out new deployments or have the<br />

proper quality controls in place to<br />

take IoT from the proof-of-concept<br />

(POC) phase to full production.<br />

Security Vulnerabilities – While<br />

IoT devices are great at doing what<br />

they are designed and built for,<br />

they typically have limited computing<br />

resources, which means<br />

they often lack built-in security<br />

features – or they are connected<br />

to the internal IT infrastructure,<br />

which poses additional risks to security.<br />

The resultant expansion of the attack<br />

surface and opportunities for<br />

cybercriminals often stems from<br />

the fact that many organisations<br />

don’t see IoT devices as a highsecurity<br />

threat, so they are not as<br />

diligent with passwords or encryption.<br />

In addition, IoT devices often<br />

don’t receive security patches as<br />

quickly as other mainstream devices,<br />

such as laptops and smartphones.<br />

All of this can lead to more<br />

IoT-related cyberattacks, as in the<br />

40<br />

038-041 Why IoT Projects Fail-JC.indd 40 26.04.22 13:10


case of a supplier of IoT cameras<br />

that discovered a software vulnerability<br />

which exposed a range of<br />

industrial devices to potential cyberattack.<br />

Limited reach – Many industries<br />

that want to use IoT solutions face<br />

the challenges of remote sites located<br />

in far-reaching geographies<br />

and areas that are hard to reach.<br />

For example, an oil rig in the middle<br />

of the ocean or a pipeline that<br />

stretches for hundreds of miles<br />

across the countryside can make<br />

it difficult to get consistent, reliable<br />

connectivity to support the<br />

transfer of data from numerous<br />

sensors out to the cloud or to endapplications.<br />

Power Consumption – Using hundreds<br />

or thousands of sensors also<br />

creates a concern that can impact<br />

cost – battery life. It’s important to<br />

explore how long a battery will last<br />

in an IoT device because the time<br />

and cost of replacement might be<br />

just as expensive as the original<br />

deployment.<br />

As a result, this can have a significant<br />

impact on the total cost of<br />

ownership (TCO) of the project<br />

– sometimes sufficient to affect<br />

overall cost-feasibility. This TCO<br />

issue can leave an organisation<br />

stuck in the POC phase, unable to<br />

move on to production.<br />

While these challenges may seem<br />

overwhelming, there are many<br />

Challenges to using IoT more<br />

Still in Progress<br />

Complexity/Technical<br />

Security<br />

Complexity/Technical<br />

Lack of Budget/Staff<br />

Complexity/Technical<br />

Lack of Budget/Staff<br />

Lack of Knowledge<br />

Security<br />

Compliance<br />

Lack of Knowledge<br />

Complexity/Technical<br />

Lack of Knowledge<br />

Leadership/Team Challenges<br />

Security<br />

Haven’t Found Right Solution<br />

options available for enterprises.<br />

Technologies such as low-power,<br />

wide-area networks (LPWANs) can<br />

provide the simplicity, scale, reach,<br />

security and power needed to take<br />

many IoT projects from concept<br />

(POC) to reality (full production<br />

deployment).<br />

Still implementing our current solutions<br />

Too complex to implement because of technology demands<br />

Security risk isn’t worth it<br />

Want to work out challenges before adding/using IoT more<br />

Don't have human resources to implement & manage<br />

Too complex to implement because of business transformation needed<br />

Don't have budget<br />

Not enough training/guidance on how to deploy<br />

Concerned about consumer privacy<br />

Too many compliance/regulatory challenges<br />

Lack technical knowledge<br />

Too long to implement<br />

Don't know enough<br />

No buy - in from senior leadership<br />

Unwilling to store data on public cloud<br />

No solution that meets our needs<br />

Where IoT Breaks Down<br />

A third of companies are still<br />

implementing their current<br />

solution; 27 percent say the<br />

technological demands are<br />

prohibitive; and another 27<br />

percent feel the security risk<br />

simply isn’t worth it.<br />

Low Power<br />

Consumption<br />

One of the key competitive<br />

advantages of<br />

LoRaWan technology<br />

is the energy efficiency<br />

of the equipment.<br />

29%<br />

27%<br />

27%<br />

26%<br />

25%<br />

24%<br />

23%<br />

22%<br />

22%<br />

21%<br />

21%<br />

20%<br />

20%<br />

19%<br />

18%<br />

17%<br />

Vendors Share the Same<br />

Environment<br />

The LoRaWAN industry standards,<br />

for example, mean that different<br />

vendors’ products can offer compatibility<br />

to allow them to easily<br />

exist in the same environment.<br />

Finally, the automated nature of<br />

these solutions allows organisations<br />

to free up employees’ time to<br />

focus on activities that positively<br />

impact sales and customer service.<br />

By having a better awareness and<br />

understanding of these key challenges,<br />

enterprises can confidently<br />

take the important first step towards<br />

solving them and making<br />

large-scale IoT deployments a reality.<br />

source ©: Hypothesis Group, Microsoft<br />

LoRaWan Differentiators & Benefits<br />

Public and<br />

Private<br />

Deployment<br />

Options<br />

Firmware<br />

Updates<br />

Over-the-Air<br />

Geolocation<br />

Bi-Directional<br />

Security<br />

10+ Year<br />

Battery Life<br />

Coverage in<br />

Rural and<br />

Non-Cellular<br />

Area<br />

Deep<br />

Penetration<br />

(Concrete,<br />

Ground, Steel)<br />

source ©: BrightTALK<br />

41<br />

038-041 Why IoT Projects Fail-JC.indd 41 26.04.22 13:10


<strong>Smart</strong> Business Industrial IoT<br />

42


Industrial IoT<br />

How to Eat<br />

the IIoT Elephant<br />

Learn, through two useful examples, how to start simple and<br />

move to more complex Industrial IoT implementations.<br />

n By Göran Appelquist*<br />

Moving to Industrial IoT<br />

can be a challenge.<br />

Through working on<br />

many customer projects<br />

over a number of years at<br />

Crosser, we have learnt that a<br />

key success factor is to start with<br />

small projects that are quick and<br />

easy to implement before gradually<br />

building up to the more advanced<br />

and complex use cases.<br />

That is, always eat the elephant<br />

in pieces, don’t try to swallow it<br />

whole.<br />

In most cases it is possible to find<br />

small and simple projects that are<br />

good starting points requiring<br />

a low effort to implement while<br />

returning value quickly. With the<br />

right tools it is easy to start simple<br />

and then add more advanced features<br />

over time.<br />

Simple Beginnings<br />

Here are some simple but useful<br />

projects, showing how they can<br />

be implemented with Crosser’s<br />

Edge Streaming Analytics. The<br />

How to get There<br />

From Here<br />

Data mismatch is a<br />

common problem in<br />

IoT. Therefore, data<br />

transformation and<br />

harmonisation play a<br />

major role.<br />

Crosser system provides a large<br />

library of pre-made building<br />

blocks (modules) that implement<br />

common functionalities for these<br />

types of use cases. By using these<br />

modules, it is easy to get started<br />

by combining modules into applications<br />

using a graphical drag<br />

and drop editor. With the interactive<br />

debugging capabilities, each<br />

application can be verified before<br />

installing them for continuous<br />

operation on Crosser Nodes that<br />

have been installed near the<br />

source ©: Crosser Technologies<br />

*Göran Appelquist is CTO at Crosser, an IIoT specialist based in Sweden and in Munich, Germany.<br />

43


<strong>Smart</strong> Business Industrial IoT<br />

systems with which they will interact.<br />

source ©: Crosser Technologies<br />

System Availability<br />

Monitoring system availability is<br />

a very common requirement. This<br />

kind of application can be created<br />

by starting with a time trigger<br />

that will fire the application<br />

once every minute, or whatever<br />

time period makes sense. A call is<br />

made to the system to be monitored,<br />

for example a programmable<br />

logic controller (PLC) or a representational<br />

state transfer (REST)<br />

endpoint. If the request fails, a<br />

notification is sent to someone<br />

using a text messaging service.<br />

Here a Modbus PLC is being<br />

polled every minute and, if no<br />

response is detected, text messages<br />

will be sent to the managers’<br />

mobile phones using the<br />

Twilio messaging service. This is,<br />

of course, a very basic application<br />

but, if failures are not expected<br />

too often, it could still be useful.<br />

The same concept can be used<br />

with any system that accepts an<br />

external request. For example, if<br />

an HTTP endpoint has to be monitored,<br />

the Modbus module can<br />

easily be replaced with an HTTP<br />

request module.<br />

When the monitor is up and running,<br />

ways to improve it can be<br />

considered. One obvious problem<br />

is that a message will be triggered<br />

every minute if the PLC stays in an<br />

unresponsive state – which could<br />

Always eat the<br />

elephant in<br />

pieces - don't<br />

try to swallow it<br />

whole!<br />

Göran Appelquist<br />

Crosser<br />

be quite annoying. It’s easily fixed<br />

just by adding a Report By Exception<br />

module so that a message is<br />

sent only when the PLC initially<br />

becomes unresponsive.<br />

If the PLC is a bit shaky, flipping<br />

back and forth between online<br />

and offline, the monitor may once<br />

again send more messages than<br />

necessary. Another easy fix is to<br />

add a Throttle module to make<br />

sure only one message is sent per<br />

hour (or whatever duration is suitable).<br />

Finally, it might be desirable to<br />

get availability statistics captured<br />

over a long timespan. Here, the<br />

Time Counter module can be<br />

used to take the same input as<br />

before to provide a summary of<br />

the times spent in each state over<br />

a specified period. The results can<br />

be sent as an uptime report once<br />

per day.<br />

The new generation<br />

integration platform<br />

allows you to integrate<br />

any device or machine<br />

data and any data<br />

source with smart<br />

workflows, events and<br />

triggers in real time.<br />

The project started with something<br />

really simple, but still<br />

useful, and then it was gradually<br />

improved to finally arrive at<br />

something that now has more<br />

functionality. The development<br />

team can decide how much further<br />

to take it and at what pace.<br />

Integrity Checking<br />

Data integrity is a broad concept<br />

with many possible applications,<br />

such as checking that values are<br />

within reasonable limits, counters<br />

are constantly incremented, or<br />

that data is updated at a certain<br />

rate.<br />

The latter case will be used here,<br />

checking that sensor data is updated<br />

at the expected rate. For<br />

this example, a subscription must<br />

be set up against an open platform<br />

communications unified<br />

architecture (OPC-UA) server that<br />

source ©: Crosser Technologies<br />

44


Guidelines<br />

The examples given share some characteristics<br />

that can serve as general<br />

guidelines when trying to identify other<br />

projects that are good starting points<br />

for edge analytics:<br />

•<br />

Find use cases that are add-ons<br />

to the existing operation, that is,<br />

ensure that neither the input nor the<br />

output systems rely on the operation<br />

of the business critical application<br />

to which they are attached.<br />

•<br />

Find uses that add value when they<br />

work but won’t have a major negative<br />

impact if they don’t.<br />

•<br />

For the first implementation, try<br />

to scale down the problem to an<br />

absolute minimum, while still adding<br />

value (minimum viable product).<br />

Then incrementally add features until<br />

the final goal has been reached.<br />

•<br />

Build an application that solves<br />

the problem when everything<br />

works normally, known as a ‘happy<br />

path’ implementation. Then add<br />

additional logic later to cover situations<br />

where things don’t work as<br />

expected.<br />

will then push back changes in<br />

values and these results will be<br />

checked every second by using a<br />

Timeout module.<br />

The Timeout module has to be<br />

set to check there are no changes<br />

within periods of 70 seconds rather<br />

than 60 seconds, chosen to offer<br />

a margin for small deviations<br />

in update frequency. This module<br />

can monitor any number of sensors<br />

and, as soon as one of them<br />

fails to deliver data in time, it will<br />

indicate which sensor has failed.<br />

In this project, the application will<br />

make an HTTP request when a sensor<br />

fails, maybe calling on the enterprise<br />

resource planning (ERP) or<br />

manufacturing execution systems<br />

(MES) to trigger further actions.<br />

With this very simple flow, thousands<br />

of sensors can be monitored<br />

as long as they have the<br />

same expected data rate. If the<br />

Getting There<br />

Build integration<br />

flows with the Flow<br />

Studio using a<br />

library of modules<br />

and connectors.<br />

Add data mapping,<br />

data transformation,<br />

triggers<br />

and events to your<br />

flows with ease.<br />

sensors, or groups of sensors,<br />

have different data rates, multiple<br />

Timeout modules can be added<br />

with differing timeout settings<br />

using a filter on each to allow the<br />

relevant sensors to be selected:<br />

These two simple but realistic use<br />

cases are good starting points for<br />

introducing edge streaming analytics.<br />

It’s possible to find many<br />

alternative but equally simple examples<br />

within any organisation.<br />

source ©: Crosser Technologies<br />

45


<strong>Smart</strong> Communications Trucking & IoT<br />

Trucking & IoT<br />

Delivering<br />

a Revolution<br />

Artificial intelligence, advanced robotics and the Internet of Things<br />

are poised to spark a revolution in the automobile industry.<br />

Automated cars have grabbed the headlines in recent years but<br />

most analysts, quite reasonably, believe<br />

that freight trucks will be the first fully-automated<br />

vehicles in regular use on the roads.<br />

n By Tim Cole*<br />

46<br />

*Tim Cole is editor of <strong>Smart</strong> <strong>Industry</strong>.


The trucking industry, and the<br />

logistics that keep it running,<br />

has become fundamental to<br />

the success of supply chains,<br />

both nationally and internationally.<br />

Without those supply chains running<br />

smoothly, allowing for just-intime<br />

orders and millions of successful<br />

daily deliveries, industries of all<br />

types would grind to a halt.<br />

The Brexit situation, with Great<br />

Britain withdrawing from the European<br />

Union, is a perfect example<br />

of the kind of chaos a broken supply<br />

chain can create. In the fall of<br />

2021, cars and trucks were lining up<br />

in front of empty pumps at UK gas<br />

stations, and supermarket shelves<br />

remained barren, all for the lack<br />

of truckers. A Road Haulage Association<br />

(RHA) survey of its members<br />

estimates there is now a shortage<br />

of more than 100,000 qualified drivers<br />

in the UK. That number includes<br />

thousands of drivers from European<br />

Union (EU) member states who were<br />

previously living and working in the<br />

UK. Issues such as this highlight the<br />

importance of the trucking industry.<br />

Time is of the Essence<br />

Yet geopolitical issues such as this<br />

are far from the only challenges<br />

currently facing freight and haulage,<br />

with market demands shifting<br />

quickly and shipments growing accordingly.<br />

In America, a report by<br />

the Federal Motor Carrier Safety<br />

Administration (FMCSA) said there<br />

were approximately 493,730 trucking<br />

companies in the US alone. Even<br />

today, most of the small business<br />

owners in the US are truckers. So,<br />

as this industry grows, it becomes<br />

necessary to track several statistics<br />

in real-time. Factors like the load on<br />

the trucks, time required for loading<br />

and unloading of goods, traffic<br />

on the travel routes, or tracking the<br />

vehicles in real-time are important<br />

to the fleet managers and truck<br />

owners of the businesses.<br />

These issues have put trucking<br />

front and centre in the eyes of those<br />

seeking industry disruption, resulting<br />

in seismic changes to the way<br />

trucking works. As with so many<br />

The driver<br />

situation is<br />

about as bad<br />

as I've ever<br />

seen it in my<br />

career.<br />

Help Wanted<br />

A Road Haulage<br />

Association (RHA)<br />

survey estimates<br />

there is now a<br />

shortage of more<br />

than 100,000<br />

qualified drivers in<br />

the UK alone.<br />

Eric Fuller<br />

CEO of U.S. Xpress<br />

other key industries in transition, it’s<br />

the Internet of Things (IoT), AI, and<br />

robotics that are leading the way<br />

and providing truly remarkable solutions<br />

to ever-growing problems.<br />

IoT has connected sensors, electronic<br />

monitors, actuators, GPS receivers,<br />

RFID systems, beacons, and<br />

so on, with a network of physical<br />

devices, appliances, vehicles, and<br />

other items for data collection and<br />

communication. In transportation<br />

and trucking, it has provided several<br />

promising solutions to develop<br />

powerful new applications and systems.<br />

When an AI-driven, long-haul<br />

industry is in place, it’s not difficult<br />

to imagine the rest of the automotive<br />

industry catching up.<br />

IoT-based solutions are transforming<br />

the trucking industry in unbelievable<br />

ways. They assure better<br />

transparency, higher operational efficiency<br />

and enhanced security – ultimately<br />

increasing profit margins.<br />

Time taken to fill last HGV driver vacancy<br />

1-2 weeks<br />

2-4 weeks<br />

4-6 weeks<br />

6-8 weeks<br />

8+ weeks<br />

0% 10% 20% 30%<br />

"Not applicable" not shown<br />

source ©: Road Haulage Association source ©: Scenic Roots<br />

47


<strong>Smart</strong> Communications Trucking & IoT<br />

source ©: Intel Corporation<br />

Trucks, which have sensors connected,<br />

travel via different routes and, at<br />

various location transmission hubs,<br />

collect and send data to the decisionmakers<br />

for the insights that help in<br />

gaining better results.<br />

Here’s a closer look at ways in which<br />

IoT and AI technology is transforming<br />

the trucking industry and how<br />

the industry will benefit from justin-time<br />

trucking and logistics.<br />

Keeping Track of<br />

Truckers<br />

Electronic Logging<br />

Devices, or ELDs, are<br />

now mandatory for<br />

commercial drivers<br />

who are required to<br />

prepare hours-ofservice<br />

(HOS) records<br />

of duty status,<br />

further increasing<br />

pressure on trucking<br />

companies who<br />

need to hire more<br />

drivers to comply.<br />

Loads of Problems<br />

Data produced by<br />

hundreds of sensors<br />

on commercial trucks<br />

is fused together in<br />

real-time to get meaningful<br />

information that<br />

optimises safety, fuel<br />

economy, and maintenance<br />

of the vehicle.<br />

Intelligent Data Driving Performance<br />

Feb16, 2016 - Dec 18, 2017<br />

Phase 1<br />

Completed<br />

Dec 18, 2017 - Dec 16, 2019<br />

Phase 2<br />

After Dec 16, 2019<br />

Phase 3<br />

A Phased Approach<br />

As the ELD rule is implemented,<br />

motor carriers will be allowed<br />

time to transition to full<br />

adoption of ELDs. This table<br />

illustrates which recording<br />

methods are acceptable during<br />

each phase implementation.<br />

ever, as the robot systems become<br />

more skilled on their routes, a future<br />

of completely driverless fleets<br />

of trucks is easily foreseeable.<br />

Fuel, insurance and drivers’ wages<br />

are obviously the trucking industry’s<br />

key expenses. By tracking the<br />

locations, driving habits and speed<br />

of the trucks in a fleet, expenses can<br />

be managed more successfully and<br />

efficiently. A combination of Big<br />

Data, AI, and IoT devices will make<br />

Awareness and Transition Phase<br />

During this time, carriers and drivers subject to the rule could<br />

prepare to comply and voluntarily use ELDs.<br />

Carriers and drivers subject to the rule could use any of<br />

the following for records of duty status (RODS):<br />

Paper logs | Logging software | AOBRDs<br />

ELDs that are self-certified and registered with FMCSA<br />

Phased-In Compliance Phase<br />

The two-year period from the Compliance Date to the<br />

Full Compliance Phase. Carriers and drivers subject to<br />

the rule can use:<br />

AOBRDs installed and in-use prior to December 18, 2017<br />

ELDs that are self-certified and registered with FMCSA<br />

Full Compliance Phase<br />

All drivers and carriers subject to the rule must use<br />

self-certified ELDs that are registered with FMCSA.<br />

ELD<br />

AOBRD<br />

Logging<br />

Software<br />

Paper<br />

Phase 1<br />

Phase 2 Phase 3<br />

Drivers and carriers exempt from the ELD rule may continue to<br />

use any of these methods of record keeping to log their HOS date.<br />

source ©: FMCSA<br />

Safety First<br />

The best argument for introducing<br />

automated vehicles and AI-driven<br />

trucks is the fact that they are safer<br />

for everyone. Long-distance routes<br />

that demand long hours of high<br />

intensity focus and alertness are<br />

dangerous for both the truck driver<br />

and other travelers. Reliable and accurate<br />

AI systems help reduce the<br />

risk of accidents, while reducing the<br />

pressure on the drivers themselves.<br />

The trucking industry is in the midst<br />

of a hiring crisis. “The driver situation<br />

is about as bad as I’ve ever seen<br />

in my career,” Eric Fuller, the CEO of<br />

U.S. Xpress, told Yahoo Finance.<br />

It’s a hard job, and fewer people are<br />

attracted to it. At the same time,<br />

demand for haulage is growing by<br />

leaps and bounds. More autonomous<br />

trucks wouldn’t merely increase<br />

staff safety, they’d also help<br />

resolve capacity issues. Currently,<br />

autonomous trucks still require<br />

human drivers in the cockpit. Howthis<br />

happen more easily and accurately<br />

than ever before and will only<br />

require giving each driver an Electronic<br />

Logging Device (ELD) as part<br />

of their smartphone setup.<br />

In 2015, Saia LTL Freight, a reputed<br />

trucking company in America, installed<br />

sensors in their trucks for<br />

tracking fuel consumption, maintenance<br />

needs and other performance<br />

metrics. This raised the fuel<br />

efficiency of the company by 6 percent<br />

saving millions of dollars.<br />

IoT technology already plays a key<br />

role when it comes to overseeing<br />

the performance of factory equipment<br />

in the manufacturing industry,<br />

highlighting when parts need<br />

replacing and keeping an eye on<br />

the smooth running of key components.<br />

There’s no reason why<br />

the same IoT data and technology<br />

couldn’t be applied to the trucking<br />

industry by installing sensors to anticipate<br />

issues before they arise or<br />

when vehicles need servicing.<br />

This is a particularly attractive concept<br />

for trucking-business owners<br />

and investors. Most of these companies<br />

can run up mountainous annual<br />

repair bills, as high as $15,000<br />

48


per vehicle plus another $4,000 for<br />

tires. Many of the issues that arise<br />

could be spotted earlier using IoT<br />

technology. Cast in this light, smart<br />

trucks would save an immense<br />

amount of money while creating<br />

safer, more efficient fleets at the<br />

same time.<br />

This aspect of AI, called predictive<br />

maintenance, allows problems to<br />

be addressed before they become<br />

severe (and more expensive), generating<br />

both peace of mind and<br />

a better ROI in the process. It’s no<br />

wonder that the vast majority of<br />

trucking business owners firmly believe<br />

that IoT technology is fundamental<br />

to their future success.<br />

Staying Fresh<br />

Sensitive cargo, such as plants and<br />

flowers or time-sensitive perishable<br />

goods, have long been a source of<br />

headaches for the entire industry.<br />

IoT technology can automatically<br />

adjust variables like temperature<br />

and humidity in order to ensure<br />

optimal conditions for such cargo.<br />

Furthermore, it can help drivers<br />

select the best routes, taking into<br />

account road conditions, construction<br />

zones and accidents to ensure<br />

a timely and well-preserved delivery,<br />

both of which are critical for<br />

consistently happy customers.<br />

In the home package delivery industry<br />

(UPS and FedEx), the ability<br />

to track individual items has already<br />

led to increased customer satisfaction.<br />

AI and IoT advancements will<br />

allow this same functionality to be<br />

applied to commercial trucking.<br />

This industry, as much as any, can<br />

use all the trust it can find in order to<br />

future proof it for decades to come.<br />

Last-mile deliveries and just-in-time<br />

services are on the increase, which<br />

means that every second makes a<br />

difference in logistic success rates.<br />

Robots working alongside personnel<br />

in warehouses or working independently<br />

and fully automated,<br />

have already made significant improvements<br />

in efficiency and timesaving<br />

procedures.<br />

Speedier loading and unloading<br />

times allow trucks to complete<br />

more orders in a day. We’re already<br />

seeing the latest robotics technologies<br />

implemented in warehouses<br />

run by companies, such as FedEx,<br />

with impressive results. Automation<br />

in the warehouse is another<br />

way to mitigate issues caused by<br />

worker shortages and offers another<br />

key investment area that could<br />

save the industry millions.<br />

An example of IoT-based solutions<br />

for the trucking industry is App-<br />

Weigh. It is a specially designed<br />

mobile app which uses Bluetoothenabled<br />

weight sensors to measure<br />

the load on air suspension trucks<br />

and trailers throughout shipment.<br />

The truck weight is directly sent to<br />

the drivers on their smartphones<br />

to keep them informed and ensure<br />

their trucks and goods are safely<br />

and legally loaded to their destination.<br />

This app can be useful to<br />

individual truck owners as well as<br />

Weighing In<br />

AppWeigh is a Bluetooth<br />

weight sensor<br />

and app for air suspension<br />

trucks and<br />

trailers that displays<br />

truck weight on a<br />

smartphone to help<br />

truckers load safely<br />

and legally.<br />

transportation and trucking companies<br />

as they alert the drivers and<br />

managers when the weight in the<br />

vehicle crosses the permissible limit<br />

and enables them to take immediate<br />

action.<br />

Endless Potential<br />

There’s no questioning the fact that<br />

robotics, IoT and AI have already<br />

enabled, and will continue to facilitate,<br />

disruption in the trucking<br />

industry, helping business owners<br />

save time and money, while staying<br />

on top of a rapidly changing and<br />

often unpredictable sector. Datadriven<br />

and tech-centric developments<br />

have been the catalysts for<br />

the digital transformation currently<br />

underway within trucking. From all<br />

indications, it appears the industry<br />

will act as a bellwether for the<br />

future of automated vehicles and<br />

logistics.<br />

While many of the technological advances<br />

predicted for the trucking industry<br />

remain in their earliest stages,<br />

it’s clear that the business of trucking<br />

has responded positively and is<br />

quick to adopt the latest IoT developments.<br />

With the potential to<br />

source ©: SKT Technologies Inc.<br />

49


<strong>Smart</strong> Communications Trucking & IoT<br />

become a bonafide, high-tech sector,<br />

the trucking industry is breaking<br />

new technological ground.<br />

Drivers need to follow strict government<br />

regulations. To comply<br />

with the Electronic Logging Device<br />

(ELD) mandate, all trucks must be<br />

equipped with electric devices in<br />

their trucks to track their working<br />

hours and activities. Legally, drivers<br />

can’t drive for more than 10 hours<br />

a day, requiring them to log working<br />

hours. With the adoption of IoT,<br />

trucking companies can easily comply<br />

with this law.<br />

Is This What the Future<br />

Looks Like?<br />

Resembling the helmet of<br />

a Star Wars stormtrooper,<br />

a driverless electric truck<br />

recently began daily<br />

freight deliveries on a<br />

public road in Sweden,<br />

in what developer Einride<br />

and logistics customer DB<br />

Schenker described as a<br />

world first.<br />

troubleshooting without having<br />

to carry well-thumbed, dog-eared<br />

manuals.<br />

Reactions to such advances are<br />

mixed. While up to 65 percent of<br />

transport executives hail automation<br />

and IoT-driven trucking as<br />

nothing short of a renaissance for<br />

the industry, there are legitimate<br />

concerns. There is a real risk of job<br />

losses – a common fear whenever AI<br />

is mentioned. There are also security<br />

concerns regarding the onboard<br />

networks of autonomous trucks<br />

being hacked by cybercriminals,<br />

though advances in anonymity networks<br />

have mitigated those risks.<br />

Yet even staunch critics admit that<br />

the benefits of IoT and AI in trucking<br />

outweigh the mostly theoretical<br />

drawbacks. IoT is a secure, reliable<br />

and cost-effective way to boost the<br />

bottom line of trucking businesses.<br />

The revolution will roll on.<br />

Not a Sound<br />

Scientists at the University<br />

of Michigan<br />

have demonstrated<br />

how sound waves<br />

can be used to<br />

detect and prevent<br />

malicious acoustic<br />

interference with<br />

autonomous truck<br />

systems.<br />

Faster, Faster!<br />

IoT-linked trucks also help the drivers<br />

to do their jobs faster and with<br />

enhanced safety, thus putting<br />

an end to the seemingly endless<br />

queues at gas stations around the<br />

world and speeding up delivery of<br />

food and other essentials. IoT saves<br />

the drivers from paperwork by electronically<br />

updating the fleet managers<br />

about delivery timings, loading<br />

weights and other operational<br />

data. Drivers can also be informed<br />

in advance about diversions, offduty<br />

hours, traffic timings, bad<br />

weather and other relevant information.<br />

When trouble strikes, they<br />

can also get assistance regarding<br />

source ©: University of Michigan<br />

50


That’s why you need storage built to<br />

capture it right where it’s generated<br />

Western Digital is a leader in storage solutions designed and tested to stand up to demanding<br />

IoT and industrial applications. These durable storage devices in a range of capacities are built<br />

for extreme temperatures and environments, and make remote monitoring a breeze.<br />

Embedded<br />

Removable<br />

SSD PCIe<br />

SSD SATA III<br />

Learn more at www.westerndigital.com<br />

Western Digital, the Western Digital logo, and iNAND are registered trademarks or trademarks of Western Digital Corporation or its affiliates in the U.S. and/or other countries.<br />

microSD is a trademark or registered trademark of SD-3C, LLC in the United States and/or other countries. All other marks are the property of their respective owners. As used<br />

for storage capacity, 1 gigabyte (GB) = one billion bytes, and 1 terabyte (TB) = one trillion bytes. Total accessible capacity varies depending on operating environment. Product<br />

specifications subject to change without notice. Pictures shown may vary from actual products. © <strong>2022</strong> Western Digital Corporation or its affiliates. All rights reserved.


<strong>Smart</strong> Business Network Transformation<br />

Network Transformation<br />

Taking Security<br />

to the Edge<br />

52<br />

The ongoing digitisation of the workplace and the rise of the distributed<br />

workforce is forcing companies to redefine the security of their IT infrastructure.<br />

Secure Access Service Edge, or SASE, is a holistic security architecture<br />

combining both network and security services in a software-defined cloud<br />

architecture which may provide the answer to these challenges.<br />

n By Sebastian Ganschow


for branch offices that were connected<br />

directly to the data center,<br />

where internal applications were<br />

hosted and Internet traffic could<br />

be filtered. But with working from<br />

home becoming an option for<br />

many employees, apps and data<br />

need to be dispersed across locations.<br />

IT teams face the challenge of<br />

providing secure, authorised access<br />

while maintaining quality of experience<br />

across any device and location.<br />

Network Security Meets<br />

Security at the Edge<br />

The Secure Access Service Edge, or<br />

SASE model is becoming increasingly<br />

important for many large organisations.<br />

Already, 24 percent of<br />

enterprises plan to develop strategies<br />

to implement the SASE approach<br />

outlined by Gartner, a consultancy,<br />

by 2024 at the latest.<br />

SASE is a cloud-centric architecture<br />

that represents a convergence<br />

of software-defined wide<br />

area networking (SD-WAN) and<br />

high security in a strategic edgeto-cloud<br />

service that adds neither<br />

hardware cost nor complexity. In<br />

other words, SASE describes an<br />

architecture that delivers network<br />

services and security functions<br />

as cloud services where they are<br />

needed: On end devices and at the<br />

SASE<br />

facilitates a<br />

better<br />

response<br />

to internal<br />

and external<br />

changes.<br />

Sebastian Ganschow<br />

is Director Cybersecurity<br />

Solutions at NTT Ltd.<br />

The End of Point<br />

Solutions<br />

SASE combines<br />

the functions of<br />

network and security<br />

point solutions in a<br />

unified, global cloudnative<br />

service, with<br />

a profound impact<br />

on several IT areas<br />

at once.<br />

edge, where a permanent connection<br />

to networks is not possible or<br />

even necessary.<br />

Although each company is taking<br />

a different path, a strategic SASE<br />

vision includes both a fundamental<br />

shift in access controls to where<br />

they are needed - the end user and<br />

the cloud edge – and the search<br />

for less complexity. Convergence<br />

of security functions in an efficient<br />

as-a-service model are a good way<br />

to achieve these goals.<br />

In addition, SASE can focus on<br />

supporting business agility to respond<br />

to all internal and external<br />

changes, while at the same time<br />

simplifying deployment, management,<br />

and enforcement of<br />

source ©: IDG Business Media GmbH<br />

SD-WAN<br />

Carrier<br />

Network Security<br />

Large enterprises still operate<br />

huge data centres. These<br />

contain not only local SaaS<br />

(Software-as-a-Service) applications,<br />

but also network components<br />

such as firewalls, load<br />

balancers, intrusion detection and<br />

prevention systems, routers and<br />

switches. Just a few years ago, it<br />

was common to design networks<br />

WAN<br />

Optimization<br />

Bandwidth<br />

Aggregation<br />

Networking<br />

Vendors<br />

Network as a<br />

Service<br />

Network<br />

CDN<br />

SASE<br />

Security<br />

DNS<br />

CASB<br />

Cloud SWG<br />

ZTNA/VPN<br />

WAAPaaS<br />

FWaaS<br />

RBI<br />

source ©: Inseya AG<br />

53


<strong>Smart</strong> Business Network Transformation<br />

a range of professionals - network<br />

engineers, application developers<br />

and security specialists. For some<br />

organisations, this means requiring<br />

a common working language between<br />

IT and security departments<br />

for the very first time.<br />

In addition, organisations need to<br />

include strategic stakeholders such<br />

as human resources, access mansource<br />

©: Musarubra US LLC<br />

policies across the board. SASE as<br />

a "secure-by-design" interface for<br />

network and cybersecurity aims at<br />

breaking down silos in order to deliver<br />

seamless, scalable, and secure<br />

Internet and cloud access anytime,<br />

anywhere.<br />

Adopting SASE requires a convergence<br />

of skills and capabilities and a<br />

new level of collaboration between<br />

The Quickest Route<br />

to SASE<br />

Decision makers seek a<br />

faster, more efficient high<br />

road to cloud and network<br />

transformation without compromising<br />

security. The need<br />

for speed and scalability is<br />

crucial, but corners cannot<br />

be cut when it comes to<br />

maintaining data and threat<br />

protection.<br />

Centralised Management<br />

with less Complexity<br />

Many organisations begin their<br />

SASE journey by introducing a centralised<br />

way to manage policy creation<br />

and monitoring. In the next<br />

step, they implement advanced security<br />

services from the data centre<br />

to each cloud required by the site,<br />

user or IoT device. By combining<br />

multiple security capabilities into<br />

a single cloud-native service, CIOs<br />

and CISOs can build greater centralised<br />

management capability with<br />

less complexity. Thus, SASE effects<br />

more than just technology conver-<br />

agement and compliance officers<br />

in the conversation. Only then can<br />

they define advanced policies for<br />

data loss prevention (DLP), cloud<br />

access security brokers (CASBs) and<br />

zero trust network access.<br />

A SASE approach requires the integration<br />

of multiple security and IT<br />

services from an organisation's first<br />

line of defense, to a DNS layer, to a<br />

secure web gateway for zero trust<br />

that enables deeper inspection, to a<br />

cloud firewall that protects web and<br />

non-web traffic.<br />

Expectations<br />

Multicloud Networking<br />

LEO Satellite Systems<br />

Software-Defined Cloud Interconnect<br />

Kubernetes Networking (CNI)<br />

AIOps Platforms<br />

Network Observability<br />

Enhanced Internet<br />

Wi-Fi 7<br />

eBPF<br />

Private 5G<br />

FACs (<strong>Smart</strong>NICs)<br />

SASE<br />

NVMe-oF<br />

5G<br />

400 Gbps Ethernet<br />

NaaS<br />

SD-Branch<br />

Network Automation<br />

Open Networking<br />

Service Mesh<br />

IPv6<br />

Wi-Fi 6<br />

SD-WAN<br />

Microsegmentation<br />

New New Path Forward<br />

SASE includes the ability to<br />

be delivered to enterprises as<br />

a managed cloud service, as<br />

well as to shift away from a<br />

traditional box-heavy branch<br />

(i.e., next-generation firewall,<br />

branch routers, etc.) to a thin<br />

branch (with SD-WAN) and a<br />

heavy cloud model.<br />

NDN<br />

6G<br />

Intent-Based Networking<br />

NFV<br />

ZTNA<br />

SDN<br />

source ©: Inseya AG<br />

54<br />

Innovation<br />

Trigger<br />

Peak of Infated<br />

Expectations<br />

Time<br />

Trough of<br />

Disillusionment<br />

Plateau will be reached: 10 yrs. Obsolete before plateau<br />

Slope of<br />

Enlightenment<br />

Plateau of<br />

Productivity<br />

As of July 2021


Traditional Hub-and-Spoke Architecture<br />

Services<br />

Apps<br />

Fast, but Just not<br />

Fast Enough<br />

Conventional<br />

hub-and-spoke<br />

architecture cannot<br />

keep pace with the<br />

escalating demands<br />

of edge-centric<br />

computing.<br />

Internet<br />

B r a n c h<br />

B r a n c h<br />

B r a n c h<br />

Headquarters<br />

D e d i c a t e d B r o a d b a n d<br />

B r a n c h<br />

B r a n c h<br />

B r a n c h<br />

source ©: Infoblox<br />

gence – it’s where business value is<br />

created and protected.<br />

Simplification and security are the<br />

two big drivers for network modernisation.<br />

One of the key benefits<br />

of this new approach is centralised<br />

network monitoring and management.<br />

Regardless of data centre<br />

or network perimeter monitoring,<br />

convergence lowers costs and increases<br />

cross-tier visibility in hybrid<br />

environments.<br />

A common framework for analysing<br />

users, applications, and data<br />

provides a comprehensive understanding<br />

of all issues and allows<br />

for faster resolution. The unified<br />

interface provides far more detailed<br />

and consistent analysis and<br />

reporting, ensuring more expeditious<br />

decision making and efficient<br />

performance management.<br />

SASE builds on the connectivity<br />

benefits of SD-WAN and includes<br />

optimised MPLS, Internet, and<br />

hybrid connectivity, as well as an<br />

integrated security system. It simplifies<br />

branch office networking by<br />

replacing the multitude of network<br />

devices found in many enterprises<br />

with a simple system that provides<br />

access to a wide range of services.<br />

This approach significantly reduces<br />

the time and effort required<br />

for configuration monitoring and<br />

troubleshooting of network and<br />

Getting the Work<br />

Done Faster<br />

Cutting the time<br />

needed to configure,<br />

monitor and troubleshoot<br />

network security<br />

functions is a great<br />

benefit.<br />

security functions. Finally, new<br />

applications or services can be<br />

deployed much faster. This is not<br />

just another argument for automation,<br />

but rather a leap forward in<br />

speedy, granular policy definition<br />

to meet rapidly changing business<br />

needs.<br />

55


<strong>Smart</strong> sensors for<br />

the next automation age<br />

The Automation age describes<br />

an epoch when machines<br />

began to perform<br />

complex tasks with little to<br />

no human interactions. Today we<br />

are experiencing a new type of automation<br />

enabled by the proliferation<br />

systems composed of interconnected,<br />

miniaturized objects and<br />

systems able to sense, process and<br />

take actions. The number of such<br />

devices is growing exponentially<br />

and with increasingly complex functionality,<br />

requiring more powerful<br />

cloud infrastructure. This creates<br />

a need to distribute intelligence,<br />

such as AI processing, throughout<br />

the system. This enables local smart<br />

controls, while helping protect user<br />

privacy and lowering overall system<br />

power consumption.<br />

Combining edge processing with<br />

cloud connectivity brings flexibility<br />

to system design and enables op-


Advertorial<br />

timal balance between offline and<br />

online capabilities. Advanced smart<br />

sensors bring intelligent processing<br />

to the point closest to the data<br />

generation by incorporating this<br />

processing capability into the sensor<br />

itself.<br />

One approach to achieve this is to<br />

equip the sensor with a Machine<br />

Learning Core (MLC) using a Finite<br />

State Machine (FSM) and advanced<br />

digital functions. Instead of using<br />

a microcontroller to process data,<br />

the MLC can run a decision tree, an<br />

inductive algorithm at a fraction of<br />

the power consumption. As a result,<br />

the system can recognize specific<br />

activities or events by observing<br />

movements or state changes and<br />

inferring from predefined patterns.<br />

This approach brings challenges<br />

for system design, particularly in<br />

terms of processing power, packaging,<br />

and power consumption. A<br />

clear challenge for sensor makers<br />

is to add AI processing capabilities<br />

without disrupting their proven solution<br />

for low noise, low power, and<br />

high accuracy - and also without<br />

changing the package form factor.<br />

Keeping the same package as existing<br />

sensors offers system designers<br />

flexibility on sensor selection without<br />

changing board design.<br />

ST has introduced a range of smart<br />

sensors that tackle these challenges<br />

starting with the LSM6DSOX<br />

launched in 2019. These sensors<br />

have a Machine Learning Core incorporated<br />

into the sensor itself with<br />

LSM6DSV16X<br />

and FSM and configurable decision<br />

trees. Our latest products continue<br />

to improve key parameters for<br />

developers such as performanceper-watt<br />

ratio. An example is the<br />

LSM6DSV16X, the newest member<br />

of our family of inertial MEMS with<br />

a machine learning core, launched<br />

earlier this year and available from<br />

mid <strong>2022</strong> .<br />

The LSM6DSV16X also introduces a<br />

new feature called Qvar to the LSM6<br />

family of devices. Engineers only<br />

need to connect two electrodes to<br />

measure variations in quasi-electrostatic<br />

potential and change two<br />

registers to enable the feature. Qvar<br />

opens the door to new applications,<br />

such as people counting. Instead of<br />

using an LED and photodiode, engineers<br />

can place electrodes on walls<br />

and measure if someone walks near<br />

them. The LSM6DSV16X remains<br />

pin-to-pin compatible with the other<br />

members of the LSM6DS family.


<strong>Smart</strong> Business EV Charging<br />

EV Charging<br />

Current Trends<br />

The electric vehicle industry is on its way to market maturity but there are still<br />

twists in the road for stakeholders and customers. From accessibility<br />

and standardisation issues to a lack of convenient and secure payment methods<br />

at charging stations, unresolved issues could still throw a spoke in the wheel<br />

of electric vehicles, leaving full adoption out of reach.<br />

n By Mark McCoy<br />

58


Electric vehicles (EVs) are<br />

cool. They offer a smooth<br />

ride and they’re good for<br />

the environment. For many,<br />

the attraction of EV ownership is<br />

also financial. For example, a 2020<br />

survey by smart charging solutions<br />

provider NewMotion, due to be renamed<br />

Shell Recharge Solutions,<br />

found that 61 percent of EV drivers<br />

were motivated to switch to save<br />

money. If so, what’s keeping them<br />

from widespread adoption?<br />

“The most common issues we see<br />

centre around accessibility and<br />

availability,” says Sjors Martens,<br />

the commercial director of chargepoint<br />

data provider Eco-Movement.<br />

“Charging points that are<br />

private or closed are a nuisance! In<br />

fact, 36 percent of charge points<br />

we receive have either restricted<br />

accessibility or are private. Without<br />

intervention from a company<br />

like ours, they’d be displayed on a<br />

map without any warning.”<br />

As if the automotive industry<br />

didn’t have enough problems already<br />

with eMobility, such as secure<br />

payment methods, concerns<br />

about carbon emissions and urban<br />

pollution are driving the manufacturers<br />

to introduce hybrid and fully<br />

electric powertrains. This work is<br />

being aided by steadily improving<br />

battery and motor technology but<br />

is being held back by the ‘chicken<br />

and egg’ problem of charging the<br />

new vehicles.<br />

To ensure that EVs have the same<br />

freedom to roam as today’s fossilfuel<br />

cars, a few challenges need to<br />

be addressed. Experts agree that<br />

charging has to become faster, the<br />

world’s network of petrol stations<br />

has to be upgraded with electriccharging<br />

facilities, and standalone<br />

charging stations will be necessary<br />

to compensate for the EV’s relatively<br />

limited range.<br />

The obvious answer is to align<br />

all charging points on data standards,<br />

providing EV drivers with a<br />

consistent experience no matter<br />

where they are. But, as Martens explains,<br />

that’s easier said than done:<br />

“Charge point operators are often<br />

source ©: Eco-Movement<br />

too busy focusing on exponential<br />

growth to work on data and standards.<br />

Furthermore, the type of<br />

charging points, definitions and<br />

regulations are vastly different<br />

across Europe alone, which makes<br />

it difficult to align perspectives.”<br />

Local conditions also dictate if<br />

private charging points can be installed,<br />

for example, having a private<br />

parking space at your home<br />

is the norm in Belgium but it’s still<br />

the exception in next-door Netherlands.<br />

Even so, resistance to EVs seems to<br />

defy logic. Even a simple back-ofthe-envelope<br />

calculation suggests<br />

that filling your tank with petrol is<br />

Charging<br />

points that<br />

are private<br />

or closed are<br />

a nuisance!<br />

Sjors Martens<br />

Eco-Movement<br />

A Winning Team<br />

Dutch ESS provider Alfen<br />

teamed up with fuel vendor<br />

Shell to deploy a 350kWh<br />

battery storage system at a<br />

forecourt in Zaltbommel, the<br />

Netherlands, offering gridbalancing<br />

services.<br />

like connecting your car to a 5MW<br />

energy source. By contrast, Tesla<br />

announced in March 2019 that<br />

its V3 Superchargers will deliver<br />

energy at rates of up to 250kW, although<br />

it will take a liquid-cooled<br />

charging cable to make it possible.<br />

EV charging obviously has a way<br />

to go before it can catch up with<br />

internal combustion engines in<br />

terms of convenience and practical<br />

reliability. It will take a combination<br />

of high voltages, high<br />

currents and sophisticated power<br />

conversion, filtering and charge<br />

management systems to close<br />

the gap. This, in turn, will demand<br />

the deployment of some pretty<br />

sophisticated connectors, cables,<br />

relays, conversion electronics and<br />

passives to ensure the same kind<br />

of fast, safe energy top-up offered<br />

by today’s petrol stations.<br />

Charging Network Growth<br />

So how close are we to a nationwide<br />

charging network that drivers<br />

can rely on when they need it,<br />

rather than having to hopscotch<br />

between charging stations? Tesla<br />

claimed it had more than 12,000<br />

Superchargers in North America,<br />

Europe and Asia at the end of 2021.<br />

This would cover more than 99<br />

source ©: Alfen N.V.<br />

59


<strong>Smart</strong> Business EV Charging<br />

The EV market Protocols<br />

percent of the US population and<br />

the company expects to achieve<br />

similar distribution in Europe by<br />

the end of this year. Tesla also<br />

claims that it recently achieved<br />

coverage of more than 90 percent<br />

of the Chinese population.<br />

Building charging networks looks<br />

like it will be big business. A report<br />

from Markets and Markets foresees<br />

that EV charging stations will<br />

grow from $3.22 billion in 2017 to<br />

$30.41 billion by 2023, an annual<br />

growth rate of 41.8 percent. The<br />

report offers a number of justifications<br />

for its forecast, including<br />

subsidy programmes for purchasing<br />

EVs in various countries, and a<br />

US government initiative to develop<br />

48 charging networks that will<br />

together cover about 25,000 miles<br />

(40,000 kilometres) of US highways<br />

across 35 states. This initiative led<br />

28 states, utilities, charging firms<br />

and electric vehicle companies,<br />

including GM, BMW and Nissan, to<br />

start working together.<br />

AC or DC?<br />

These raw numbers appear encouraging<br />

for potential EV drivers<br />

but mask the fact that there is still<br />

a lot of variety in charging methods,<br />

the infrastructure available<br />

to support them and, therefore,<br />

TSO<br />

System Operator<br />

• eclearing.net<br />

• Gireve<br />

• Hubjet<br />

Common Cause<br />

The evRoaming4EU consortium<br />

is a partnership project<br />

aimed at ensuring that<br />

any EV driver will be able<br />

to charge at any charging<br />

station in the EU. Its goal<br />

is to address and resolve<br />

functional, technical,<br />

legal, and fiscal obstacles<br />

that exist today between<br />

different countries within<br />

the European Union and<br />

create a mature European<br />

market for EV charging.<br />

infrastructure.<br />

Hub<br />

Roaming<br />

Platform<br />

DSO<br />

Grid Operator<br />

Sustaiable Home /<br />

<strong>Smart</strong> Home<br />

A Growing Market<br />

The EV charger market<br />

in Europe alone reached<br />

1.7 million in 2020,<br />

says IHS, and further<br />

explosive growth is to be<br />

expected over the next<br />

few years.<br />

OCPI (Hub)<br />

OCHP<br />

OICP<br />

eMIP<br />

OSCP<br />

MSP<br />

Service<br />

Provider<br />

OCPI (P2P)<br />

Adm<br />

CPO<br />

Tech<br />

CPO<br />

their usability to the average user.<br />

One big issue has the potential to<br />

reignite the legendary War of the<br />

Currents between Thomas Edison<br />

and George Westinghouse in<br />

the late 1880s and early 1890s.<br />

Edison’s arc lamp street lighting<br />

system ran on low-voltage direct<br />

current (DC), while Westinghouse<br />

championed the rival alternating<br />

current (AC) power distribution<br />

network, which ultimately<br />

triumphed – but not before the<br />

two engineers-turned-entrepreneurs<br />

threw mud at each other,<br />

with Edison even going so far as<br />

to equate Westinghouse and his<br />

system with the electric chair.<br />

The real difference between the<br />

two charging strategies is where<br />

EV driver<br />

OCPP<br />

ISO 15118<br />

Charging Point<br />

Open ADR/<br />

IEC 61850<br />

Energiy Supplier<br />

the necessary transformation is<br />

done. Electric grids deliver AC<br />

which needs to be rectified to the<br />

appropriate DC charging voltage<br />

with the help of technology built<br />

into the car itself. DC charging<br />

stations, on the other hand, use<br />

larger, more efficient and bettercooled<br />

rectification circuitry than<br />

would be possible in a vehicle.<br />

Many predict that, over time, AC<br />

charging stations will do their<br />

own rectification but the jury is<br />

still out.<br />

In addition to charging power,<br />

the decision to use either AC or<br />

DC charging also depends on<br />

the capital costs of rectification<br />

and who will pay: the operators<br />

of the DC charging networks or<br />

source ©: Netherlands Enterprise Agency<br />

Global Cumulative Charging Station Deployments (2014 – 2020)<br />

source ©: IHS Automotive<br />

60<br />

14<br />

12<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

2011 2012 2013 2014 2015 2016 2017 2018 2019 2020


the owners of e-vehicles charged<br />

with AC. Some charging standards<br />

also allow bi-directional<br />

energy flow, so a distributed network<br />

of charging vehicles can<br />

act as both an energy sink and a<br />

source to stabilise the energy grid<br />

– which could lead to regulatory<br />

support in some regions.<br />

While some automobile vendors<br />

like Tesla are trying to control their<br />

customer base by installing proprietary<br />

chargers and connectors,<br />

others like BMW, Mercedes-Benz<br />

maker Daimler, Ford and the Volkswagen<br />

Group, which includes<br />

Audi and Porsche, are all backing<br />

a multi-vendor, multi-technology<br />

standard known as the Combined<br />

Charging System (CCS).<br />

As has been seen multiple times<br />

in other technology evolutions,<br />

the perceived benefits of lock-in<br />

are slowly giving way to standardisation<br />

efforts, as EV customers<br />

begin to demand ubiquitous<br />

charging facilities and weigh their<br />

availability more highly in their<br />

buying decisions. This is leading<br />

to a shake-out in the market<br />

for EV charging. Nissan and Mitsubishi<br />

have backed CHAdeMO<br />

(Charge de Move), which allows<br />

bi-directional charging. China,<br />

the world’s largest EV market, is<br />

establishing GB/T (which means<br />

it’s a favored Chinese regulation)<br />

as its charging standard.<br />

There is obviously still a lot of<br />

room for component manufacturers<br />

to innovate. For example,<br />

if rectification in the vehicle becomes<br />

more efficient, this will<br />

have a direct impact on the utility<br />

of an e-vehicle by enabling faster<br />

charging with AC power. Even the<br />

design of the plug will be a critical<br />

factor in the speed of charging<br />

and all this will help increase the<br />

practical range of an electric vehicle<br />

(see boxout).<br />

Of course, all of these innovations<br />

will have to comply with<br />

national and international standards,<br />

many of which are still being<br />

developed and agreed. As EVs<br />

move ahead to replace fossil-fuel<br />

vehicles, the race for EV market<br />

dominance will almost certainly<br />

be fast and furious.<br />

Interview<br />

How close are we to a nationwide<br />

charging network or maybe<br />

even to a Europe-wide charging<br />

network?<br />

With ISO 15118, we actually have<br />

a pretty good world-wide stansource<br />

©: Thomas Wagner<br />

We need a<br />

faster rollout.<br />

Thomas Wagner<br />

Of in-tech, a pioneer<br />

smart charging company<br />

based in Bavaria<br />

dard, except for China and Japan<br />

which choose to go their own<br />

way. Most companies are working<br />

together because they know<br />

that’s where the future of electromobility<br />

lies, namely in vehicle to<br />

grid and sectoral coupling of energy<br />

and mobility.<br />

Is the energy sector ready?<br />

I think the energy sector needs<br />

to talk more with the mobility<br />

sector, and vice versa. We need<br />

a faster rollout. It’s important<br />

that everyone profits: the manufacturers,<br />

the operators, the end<br />

users, and, of course, both the<br />

charging business and the energy<br />

sector.<br />

What are the biggest priorities<br />

in radically expanding electricvehicle<br />

(EV) charging infrastructure<br />

We need much higher numbers<br />

of charging stations and we need<br />

them much faster as electric vehicle<br />

sales are gaining speed. So I'm<br />

mainly talking about high power<br />

charging parks and also AC charging<br />

at home and at work.<br />

What role will governments play?<br />

After all, many legal standards<br />

and regulations aren’t even fully<br />

developed yet.<br />

Right, national politics has to<br />

support international standards<br />

and international business cases<br />

because EV will be a truly global<br />

market.<br />

61


<strong>Smart</strong> Lifestyle Urban Renewal<br />

Urban Renewal<br />

The<br />

<strong>Smart</strong>est<br />

City<br />

In 2000, Barcelona’s council created 22@ Barcelona<br />

as an urban transformation project with the aim of turning a rundown<br />

industrial area called Poblenou into a new innovation district.<br />

Today, the neighborhood is buzzing with creative startups,<br />

research centres and international businesses and is regularly touted<br />

as an example of urban, economic and social renewal.<br />

62


The Poblenou district of Barcelona<br />

long reflected the wider<br />

malaise of Barcelona. Once<br />

a thriving industrial district<br />

in the 19th Century, it gradually became<br />

the ideal canvas for spraycanwielding<br />

graffitists. Between 1970<br />

and 1990, some 1,300 firms closed,<br />

leaving the area littered with abandoned<br />

buildings: a decaying postindustrial<br />

landscape.<br />

Barcelona’s city council seized the<br />

opportunity offered by the 1992<br />

Olympics to refresh the city. A modern<br />

infrastructure, revamped neighborhoods,<br />

greener parks and a new<br />

two-kilometre sandy beach opened<br />

the city up to the Mediterranean Sea.<br />

The revitalisation made Barcelona a<br />

tourist must-visit destination again.<br />

And Poblenou? It, too, is awakening<br />

from its long sleep to become a<br />

torch bearer for urban renewal.<br />

Much of Poblenou’s renaissance has<br />

been built on IoT systems. Starting in<br />

2012, the city deployed responsive<br />

technologies across public transport,<br />

parking, street lighting and<br />

waste management systems as part<br />

of a <strong>Smart</strong> City Barcelona plan.<br />

Transitioning to a more energyefficient<br />

LED lighting system has<br />

led to cost savings. Sensors in lampposts<br />

identify when pedestrians are<br />

near and dim automatically if the<br />

streets are empty to save energy.<br />

The lampposts form part of a WiFi<br />

source ©: El País<br />

network, too, providing consistent,<br />

city-wide, free connectivity anytime,<br />

anywhere. The network is also integrated<br />

into Sentilo, a system of over<br />

19,500 smart meter sensors that receive<br />

data on weather, pollution and<br />

noise. IoT devices also monitor rain,<br />

humidity and soil moisture in city<br />

gardens. Using the data, gardeners<br />

can remotely programme electrovalves<br />

to deliver any irrigation needed.<br />

This has resulted in savings of approximately<br />

€500,000 per year.<br />

For cars, embedded sensors in parking<br />

bays identify if they are occupied.<br />

Drivers are guided to available<br />

spaces through ApparkB, an app<br />

that allows online payment for parking.<br />

This has reduced congestion<br />

and emissions.<br />

The innovations continue with<br />

smart pneumatic waste bins that<br />

Home to the Future<br />

Ten universities, nine<br />

R&D and technology<br />

transfer centres, and a<br />

spaceship tower,<br />

the 142 m high Torre<br />

Glòries, Barcelona's<br />

new signature skyscraper.<br />

City in the City<br />

The Interface Building,<br />

headquarters of the<br />

Telecommunications<br />

Market Commission,<br />

contains over 42,000<br />

sqm of office space.<br />

reduce odors and new interactive<br />

bus stops, powered by solar panels,<br />

offer USB charging stations and updates<br />

on bus arrivals.<br />

The Knowledge<br />

Neighbourhood<br />

In 2000, €200 million was earmarked<br />

to foster the Barcelona technology<br />

industry. Twenty-two acres of Poblenou<br />

was to be recast as an innovation<br />

district and its name change<br />

said it all. Formerly called 22a (Industrial),<br />

it became 22@ – tagging<br />

it as a digital testing ground. Visit<br />

the district today and any fresh graffiti<br />

will be by renowned local artists,<br />

commissioned by one of the design,<br />

energy, media or scientific research<br />

companies that call 22@ home.<br />

The triangle formed between the<br />

seafront, Avinguda Diagonal and<br />

Ciutadella Park is a hotbed of innovation.<br />

Five universities and academic<br />

institutions have a presence,<br />

and co-working spaces, incubators<br />

and startups abound.<br />

Famous brands present include Amazon,<br />

HP, T-Systems, Ricoh, Schneider<br />

Electrics and Vice Media. Sergio<br />

Ruiz, CEO of the Signaturit Group,<br />

an electronic signature software<br />

company, says the decision to open<br />

in Poblenou was easily made.<br />

“You can really breathe innovation<br />

and technology here,” he explains.<br />

“22@ is a hub that allows us to connect<br />

with other technology companies<br />

and promote innovation. This<br />

allows the development of new opportunities<br />

in our business. It is the<br />

ideal ecosystem for synergies.”<br />

source ©: patrizia.ag<br />

63<br />

source ©: Innovation Academy e.V.


<strong>Smart</strong> Lifestyle Urban Renewal<br />

It is estimated that 4,500 new companies<br />

have come to Poblenou<br />

since 2000. Of these, 47 percent<br />

are startups, and 31 percent are<br />

technology or knowledge-based<br />

companies. Before Covid-19 struck,<br />

around 56,000 tech talents had<br />

been attracted to the area and the<br />

total number of jobs created was<br />

estimated at 150,000.<br />

Old Charm, New Tech<br />

Poblenou is far from a business district<br />

where the lights go out at night.<br />

The redevelopment was not intended<br />

to run slipshod over existing residents<br />

but to make 22@ an appealing<br />

place to live. This included developing<br />

4,000 units of subsidised housing,<br />

creating new green areas, remaking<br />

streets and providing facilities for the<br />

public, such as schools and community<br />

centres.<br />

For this, the support of the real estate<br />

sector was critical. If educated professionals,<br />

tech-savvy workers and other<br />

creatives were to be attracted, they<br />

needed office and living spaces. By<br />

2011, there were 139 plans submitted<br />

for urban redevelopment, 84 from<br />

the private sector.<br />

"What caught our eye was not just<br />

the basic economics and demographics,<br />

it was also that people want<br />

to live there, that the universities are<br />

Cool Quarter<br />

With Poblenou,<br />

Barcelona has succeeded<br />

in rebranding<br />

itself as a city<br />

for business, talent<br />

and innovation.<br />

More Than Green<br />

The 22@Barcelona<br />

project transforms two<br />

hundred hectares of<br />

industrial land of Poblenou<br />

into an innovation<br />

hub. An estimated<br />

4,500 new companies<br />

have come to Poblenou<br />

since 2000. Of these,<br />

47 percent are startups.<br />

expanding, and that 22@ is increasingly<br />

regarded as a smart city," says<br />

Eduardo de Roda, country manager<br />

for Patrizia, an international asset<br />

management company focusing on<br />

innovation technology in the real estate<br />

industry.<br />

On behalf of clients, Patrizia has invested<br />

in five office and residential<br />

buildings. Two are redevelopments<br />

of old industrial space and the goal<br />

is to create sustainable buildings, reflecting<br />

the changing local environment.<br />

“Although 22@ is one of the largest<br />

urban regeneration areas in Europe,<br />

there is still a major shortage of Grade<br />

A office stock. We aim to address that<br />

demand,” says de Roda.<br />

Walk the streets of Poblenou and you<br />

find a lively scene, half bohemian<br />

and half cybernetic. La Rambla del<br />

Poblenou, the promenade that cuts<br />

through the district to the sea, has<br />

been revitalised with top-notch restaurants,<br />

microbreweries and shops.<br />

In the backstreets alternative art galleries,<br />

advertising agencies, architect<br />

firms, dance companies and designer<br />

showrooms burnish the reputation<br />

of Poblenou as Barcelona’s cool new<br />

barrio. It is certainly an eclectic mix.<br />

source ©: Parametric Places: Data Making + Public Space<br />

64


source ©: Patrizia AG<br />

Modernista constructions like the<br />

tubular Torre Glòries and the Design<br />

Museum of Barcelona loom large –<br />

but there has been considerable effort<br />

to preserve the heritage.<br />

Cisco invested $30 million in developing<br />

a co-innovation centre, focused<br />

on the Internet of Everything (IoE),<br />

in a former textile factory. An artistic<br />

colony occupies the Palo Alto Market<br />

area, and the Pompeu Fabra University's<br />

Communication Campus and<br />

From old to new<br />

The former industrial<br />

slum of Poblenou has<br />

been transformed<br />

into the throbbing<br />

heart of a new city by<br />

a mix of careful conservation<br />

and striking<br />

modernisation.<br />

the Fundació Vila Casa Museum are<br />

housed in renovated textile factories.<br />

November 2020 marked the twentieth<br />

anniversary of the 22@ urban<br />

planning project and provided an<br />

opportunity to reassess its direction.<br />

The council plans to open the district<br />

to green companies and more<br />

space was earmarked for 9,300 rental<br />

homes – but this looks like it will be<br />

increased to around 15,800 residential<br />

apartments.<br />

“It is the mix of uses that we like about<br />

22@,” explains de Roda. “How the office<br />

and living spaces are revitalising<br />

the quarter to create a new, dynamic<br />

and compelling lifestyle. That’s the<br />

attraction for the creative classes and<br />

will ensure they will continue to be<br />

drawn to the area.”<br />

Interview<br />

Solutions by the People, for the People<br />

How is Barcelona approaching<br />

IoT?<br />

Barcelona is transforming itself into<br />

a true smart city. The areas they have<br />

focused on – environmental monitoring,<br />

parking, waste disposal and smart<br />

lighting – provide them with a solid<br />

platform for continuing to develop in<br />

the future. Importantly, they have put<br />

all this in place not for the sake of the<br />

technology but because it provides<br />

solutions for the needs of people.<br />

What are the main challenges?<br />

First – scale. With a project like this,<br />

you only benefit when you cover a<br />

large area. This can pose problems<br />

because of the physical environment<br />

or the ‘not in my backyard’ attitudes.<br />

Barcelona has overcome this by effectively<br />

scaling proven technology from<br />

its Urban Lab out over the wider city.<br />

Any others?<br />

There are issues concerning retrofitting<br />

the urban landscape to handle<br />

new technology. For example, providing<br />

power to the parking place<br />

sensors. There is also security. A parking<br />

app helps cut down on pollution<br />

and congestion but it also marks<br />

where the car and owner will be for<br />

the next few hours, so security is an<br />

issue.<br />

There are some pretty nifty<br />

gadgets installed around here. Is<br />

theft a big problem?<br />

With such innovative products, tampering<br />

happens more often than you<br />

might think. Safeguards have to be<br />

put in place to protect the devices.<br />

What’s the payback?<br />

There are two: cost savings and the<br />

ability to influence behavior. Thanks<br />

to IoT, Barcelona has reduced congestion<br />

and lowered car emissions,<br />

water and energy costs. It has also<br />

brought significant economic development.<br />

The quality of life for<br />

residents, workers and visitors has<br />

Thanks to IoT,<br />

Barcelona<br />

has reduced<br />

congestion and<br />

lowered car<br />

emissions,<br />

water and<br />

energy costs.<br />

Giulio Spinelli<br />

EMEA <strong>Smart</strong> City<br />

Business Development<br />

Manager and technology<br />

specialist for timing and<br />

sensing at Avnet Silica,<br />

lives and works in Milan<br />

also improved. Also, collecting data<br />

can help government agencies place<br />

infrastructure where it’s needed in a<br />

far more focused manner. When that<br />

data is also made available to the<br />

public in effective formats, it can encourage<br />

behavioral changes. People<br />

can see it is far quicker to take a bike<br />

than a car for a short trip, or to leave<br />

a trip until later when the pollution<br />

will not be as bad.<br />

source ©: Facebook<br />

65


<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />

IoT and Fighting Forest Fires<br />

Internet of<br />

Trees<br />

66


An hour can make all the difference. In an hour you can weed the<br />

garden, mow the lawn, plant a tree. In that same hour,<br />

as gardeners who make compost may know to their cost,<br />

a smouldering pile of biomass can easily burst into flames.<br />

When this happens in a forest, it can start a fire that<br />

ravages thousands of square kilometres and costs hundreds<br />

of millions of dollars to control.<br />

n By Mark McCoy<br />

Being able to discover forest<br />

fires early is an increasingly<br />

urgent issue. According<br />

to Cal Fire, California’s<br />

firefighting agency, nine of California’s<br />

20 largest fires to date<br />

have occurred since 2020. California’s<br />

Dixie fire, which began in<br />

mid-July 2021, grew to consume<br />

almost 4,000 square kilometres of<br />

forest by the end of September.<br />

According to the New York Times,<br />

authorities spent more than $610<br />

million over those three months<br />

to bring it under control. There<br />

have been similarly extreme fires<br />

over the past five years in places<br />

as far afield as Australia, Greece,<br />

and Portugal. And it’s a growing<br />

issue: the map below shows just<br />

how much of the planet’s surface<br />

Fires are a<br />

growing Issue<br />

A map of global<br />

vulnerability<br />

to wildfires.<br />

is now extremely vulnerable to<br />

wildfires.<br />

The ability to find and suppress<br />

forest fires before they take hold is<br />

therefore of immense value, but it’s<br />

a hard problem to solve given how<br />

large forests can be, the lack of infrastructure<br />

within them, and the<br />

challenge of sensing the earliest<br />

stages of a fire before it bursts into<br />

flames. A Berlin-based startup has<br />

decided to be up for the challenge<br />

and is addressing it by developing<br />

advanced sensing nodes and highly<br />

distributed networking technology.<br />

Although Dryad’s initial focus<br />

is to detect fires, it expects that its<br />

system will also be able to monitor<br />

other aspects of forestry, such<br />

as soil moisture, tree growth, sap<br />

flow, and even illegal logging.<br />

source ©: Dryad Networks<br />

67


<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />

The same technology should also<br />

enable air and water quality monitoring<br />

over large areas.<br />

A Network of Networks<br />

Dryad’s Silvanet is made up of five<br />

major components: three pieces<br />

of hardware, a proprietary RF networking<br />

technology that extends<br />

the reach of the LoRaWAN protocol,<br />

and a cloud analytics and<br />

alerting platform. The whole system<br />

has been designed to overcome<br />

the overarching constraints<br />

of the lack of power and connectivity<br />

in forests.<br />

Dryad’s Silvanet<br />

Wildfire Sensor<br />

is designed to<br />

operate for up<br />

to 15 years from<br />

onboard solar<br />

cells.<br />

source ©: Cision<br />

The Silvanet Wildfire<br />

Sensor<br />

The sensing node for Silvanet is a<br />

solar-powered device that uses a<br />

sensor to measure temperature,<br />

humidity, and air pressure, as well<br />

as the concentrations of gases including<br />

hydrogen, carbon monoxide,<br />

carbon dioxide and volatile<br />

organic compounds at sensitivities<br />

of parts per million. A lowpower<br />

microcontroller, which integrates<br />

support for the LoRaWAN<br />

protocol, runs algorithms based<br />

on machine-learning (ML) strategies<br />

to process sensor data to reduce<br />

the energy burden of communicating<br />

it in raw form over the<br />

LoRaWAN RF network.<br />

The Wildfire Sensor is designed<br />

to run for up to 15 years without<br />

maintenance or a battery, which<br />

avoids introducing potentially<br />

flammable materials such as lithium<br />

into the forest.<br />

Silvanet is<br />

de signed to overcome<br />

the constraints<br />

of the lack<br />

of power and connectivity<br />

in forests.<br />

Carsten Brinkschulte<br />

Dryad Networks<br />

The Silvanet Mesh Gateway<br />

The Silvanet Mesh Gateway uses<br />

a LoRa concentrator chipset to<br />

implement the low-power, low<br />

data-rate LoRaWAN protocol,<br />

which is used to communicate<br />

with the Silvanet Wildfire Sensors<br />

and with third-party sensors that<br />

properly implement the standard.<br />

LoRaWANs usually have a star architecture,<br />

in which each end-node<br />

device, such as the Wildfire Sensor,<br />

has a direct relationship with the<br />

LoRaWAN gateway and through<br />

it to the internet. Although this<br />

approach is simple and widely<br />

implemented, it limits the reach<br />

of LoRaWAN networks to a circle<br />

whose radius is defined by the RF<br />

range from node to gateway. This,<br />

in turn, limits how far a LoRaWAN<br />

network can reach into a forest and<br />

hence its utility for early fire detection<br />

over large areas.<br />

Dryad’s key innovation is to extend<br />

the LoRaWAN with proprietary<br />

technology that links the<br />

gateways to each other to form<br />

a mesh of star networks, which<br />

together can reach much more<br />

deeply into a forest. The Silvanet<br />

Mesh Gateways are also solarpowered<br />

and designed to be<br />

mounted on trees at about three<br />

metres above the ground.<br />

Carsten Brinkschulte, CEO of Dryad,<br />

said: “The mesh is the magic<br />

of what we're doing. Standard<br />

LoRaWAN has a star network architecture<br />

so you can buy dozens<br />

of LoRa gateways, but they<br />

all have one problem. They all<br />

need to be connected directly<br />

to the internet. We place a mesh<br />

gateway every three kilometres<br />

which extends the coverage of<br />

the LoRaWAN network deep into<br />

the forest. Then we have a pro-<br />

source ©: Dryad Networks<br />

68


prietary protocol to connect from<br />

mesh gateway to mesh gateway.”<br />

The Silvanet Border<br />

Gateway<br />

Silvanet WildFire Sensors and Silvanet<br />

Mesh Gateways together<br />

can create an extensive ‘Internet<br />

of Trees’ among themselves, but<br />

they need a Silvanet Border Gateway<br />

to reach the wider internet.<br />

The Silvanet Border Gateway is designed<br />

to be placed at the edge of<br />

the forest, perhaps in a visitor’s car<br />

park or nearby building, to link the<br />

mesh network to the wider internet<br />

and then on to the Silvanet Cloud<br />

Platform. Each Border Gateway can<br />

act as a LoRa gateway, using the<br />

LoRa concentrator chipset. It can<br />

also implement 4G connectivity<br />

using the LTE-M standard and fall<br />

back to 2G and GPRS protocols if<br />

necessary. For even more remote<br />

deployments, the Silvanet Border<br />

Gateway can connect to the internet<br />

using the SWARM satellite network.<br />

The Border Gateway can be powered<br />

by solar cells, if necessary,<br />

although there is also support for<br />

wired power and Ethernet connectivity<br />

if that is available at the<br />

border site.<br />

The Silvanet Cloud Platform<br />

The sensor nodes, mesh networks<br />

and gateways are designed to<br />

bring pre-processed data from<br />

throughout the forest to the<br />

Silvanet Cloud Platform, which<br />

provides a complete solution for<br />

wildfire detection and monitoring<br />

the health and growth of the<br />

forest. The Silvanet application<br />

groups sensor devices and gateways<br />

either by geographical area,<br />

or by characteristics. Details related<br />

to each sensor, especially their<br />

fire status, are shown on a map.<br />

source ©: Dryad Networks<br />

The Silvanet Mesh<br />

Gateway<br />

connects multiple<br />

LoRa star networks<br />

into a daisy-chain<br />

with greater reach.<br />

The Engineering Challenge<br />

Dryad has an experienced team<br />

of founders with a wide variety of<br />

relevant skills but implementing<br />

Silvanet is still a challenge. Along<br />

with the hardware, it includes firmware<br />

development for energy-constrained<br />

data analytics, support for<br />

over-the-air updates, IoT security,<br />

implementing the LoRaWAN and<br />

ensuring standards compliance,<br />

creating the proprietary links between<br />

Mesh Gateways, integrating<br />

multiple forms of RF connectivity<br />

in the Border Gateways, and the<br />

cloud platform and analytics. All<br />

this must be achieved in equipment<br />

working at low power, with<br />

solar panels that are often in shade,<br />

in the difficult RF environment of a<br />

forest, and with the ruggedness to<br />

ensure long operating lifetimes.<br />

And, especially for the Wildfire Sensors,<br />

it must be done at the lowest<br />

possible cost to enable wide deployment.<br />

Brinkschulte says: “If you want to<br />

put something else on the list, RF<br />

communications in the forest is<br />

challenging because every tree is<br />

an obstruction full of water that<br />

absorbs radio waves.”<br />

There are other challenges with<br />

the RF implementation. Both<br />

69


<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />

the LoRaWAN and the 4G radios<br />

in the Border Gateways must be<br />

on all the time because they must<br />

be ready to accept data from the<br />

Wildfire nodes or inbound messages<br />

from the cloud. If 4G LTE-M<br />

connectivity is unavailable, falling<br />

back to 2G protocols also boosts<br />

power consumption.<br />

“A key challenge for us is the ultralow<br />

power design of the sensor<br />

Whispering Forests<br />

The Silvanet Border<br />

Gateway brokers<br />

communication<br />

between the mesh of<br />

LoRa networks and<br />

the internet.<br />

hardware,” says Brinkschulte. “We<br />

need to work in an environment<br />

where we have very little energy<br />

input, yet we have to do something<br />

complex. We need to scan for gas<br />

compositions and run ML software,<br />

it needs to work reliably, and we<br />

need to detect fires very quickly.<br />

These are contradicting goals, and<br />

so one challenge is to select the<br />

right ultra-low power components.<br />

“At the same time, price is key<br />

because we will need to put hundreds<br />

of thousands if not millions<br />

of Wildfire Sensors in a forest for<br />

the system to work, and the price<br />

of each component at that scale<br />

determines the system cost. We<br />

can’t choose a component that<br />

performs extremely well but<br />

pushes the Bill of Material up by<br />

five euro and kills the product.”<br />

source ©: Dryad Networks<br />

Partnering for<br />

Market Insights<br />

Dryad has worked with Avnet<br />

Silica to explore its options for<br />

components that can meet these<br />

tough challenges.<br />

For example, the initial design<br />

uses a single- and dual-core microcontroller<br />

which offers ultra-low<br />

power operation and integrates<br />

LoRa radio, while having the performance<br />

to analyse sensor data<br />

with enough sophistication to detect<br />

wildfires early, without creating<br />

false positives.<br />

“We have to do that in the sensor<br />

because we do not have enough<br />

bandwidth to transmit all of the<br />

sensor data to the analytics in the<br />

cloud,” according to Brinkschulte.<br />

“We really appreciate the competent<br />

discussions we're having<br />

with Avnet Silica. They are bringing<br />

a lot of ideas and proposals for<br />

components which may optimise<br />

the performance of the system.”<br />

Dryad is already looking at potential<br />

optimisations of the hardware<br />

designs with even lower power<br />

and even lower costs, “and that's<br />

a constant discussion that we're<br />

having on which chipsets to use.<br />

We need to have it at really low<br />

cost and ultra-low power because<br />

if you halve the power consumption<br />

of the device you can halve<br />

the size of the solar panel and<br />

energy storage, which are key<br />

price-driving factors of the sensor<br />

node”, Brinkschulte notes.<br />

Dryad is using super-capacitors to<br />

store energy from the solar cells,<br />

rather than introducing potentially<br />

toxic and flammable rechargeable<br />

batteries into the forest.<br />

70


The network architecture of Silvanet<br />

source ©: Dryad Networks<br />

“If you can reduce power consumption<br />

you can reduce the<br />

capacity of the super-capacitors,<br />

which would also drive down the<br />

price. Super-capacitors are not yet<br />

commoditised, and so selecting<br />

the right components is definitely<br />

something where Avnet Silica has<br />

the competency to advise us on selecting<br />

which may perform better,<br />

have better availability, or a better<br />

price.”<br />

Dryad’s use of the parts is also a<br />

little unconventional in that supercapacitors<br />

are more widely used<br />

to provide enough energy to enable<br />

systems that have suddenly<br />

lost mains power to do an orderly<br />

shutdown.<br />

“There's lots of specific things that<br />

we need to do to charge the super-capacitors<br />

from the solar cell,<br />

so we need charging circuits that<br />

actually do that and that is a bit<br />

more challenging because it's not<br />

the standard way of doing things,”<br />

Brinkschulte adds.<br />

Avnet Silica is also helping Dryad<br />

understand current supply constraints<br />

for various parts, caused<br />

by supply-chain issues ranging<br />

source ©: Avnet Silica<br />

from the pandemic through to<br />

factory fires. It has been trying to<br />

ensure that Dryad chooses components<br />

that will be available in<br />

enough volume to allow it to roll<br />

out Wildfire Sensors and Gateways<br />

in volume.<br />

“When you move to your go-tomarket<br />

strategy and try to roll<br />

out your network and the quantity<br />

goes up, you need to have the<br />

microcontrollers and other parts<br />

delivered on time,” says Ingo Seehagen,<br />

senior field application engineer<br />

at Avnet Silica.<br />

From Tree<br />

to Tree<br />

The network<br />

architecture of<br />

Silvanet<br />

When you roll<br />

out your network,<br />

you need<br />

to have your<br />

parts delivered<br />

on time.<br />

Ingo Seehagen<br />

Senior field application<br />

engineer at Avnet Silica<br />

Dryad’s Vision<br />

According to Brinkschulte, wildfire<br />

sensing is just the first application<br />

of the Dryad networking technology.<br />

“This is a generic IoT communications<br />

infrastructure for the forest.<br />

There are tons of applications that<br />

forestry can benefit from once our<br />

infrastructure is in place. Soil moisture<br />

is one of them, tree growth,<br />

sap flow, anti-logging alerts using<br />

sound detection, and emergency<br />

communication for forest workers.”<br />

Forestry equipment maker Stihl is<br />

one of Dryad’s backers. “We create<br />

an IoT network infrastructure that<br />

digitises the forestry industry, and<br />

I guess that's of strategic interest<br />

to them,” says Brinkschulte.<br />

The deal also gives Dryad access to<br />

Stihl’s electronics manufacturing<br />

services, and all the tacit knowledge<br />

and expertise it has in making<br />

rugged electronics for use in<br />

challenging environments.<br />

“That is an advantage for us because<br />

if the mothership uses them,<br />

and the baby uses it as well, that<br />

means they give us good attention.”<br />

71


<strong>Smart</strong> Lifestyle Mobile Services<br />

72


Mobile Services<br />

Taking 5G<br />

to the Max<br />

The pandemic has increased business and<br />

user reliance on mobile services and paved the way for 5G.<br />

But why is it still so difficult to predict<br />

how useful 5G will be?<br />

n By Tom Leddo*<br />

The return on<br />

investment<br />

of 5G for the<br />

operators is<br />

by no means<br />

certain.<br />

Timotheus Höttges<br />

CEO of Deutsche Telekom<br />

<strong>Smart</strong> cities, self-driving vehicles<br />

and advanced robotics<br />

are just the tip of the iceberg:<br />

there's no doubt that<br />

5G will radically change the world.<br />

As far back as 2017, Timotheus<br />

Höttges, the CEO of Deutsche<br />

Telekom, gave an estimate for a<br />

nationwide 5G network in Europe,<br />

saying that the costs could amount<br />

to €300 billion to €500 billion - for<br />

a product whose "return on investment"<br />

for the operators was by no<br />

means certain. Which responsible<br />

businessman would invest such<br />

sums without knowing if and how<br />

such an investment might pay off?<br />

The world is a different place<br />

today than it was before the<br />

COVID-19 lockdowns. Our dependence<br />

on wireless services<br />

has increased dramatically, as has<br />

the demand for more speed and<br />

bandwidth. It would be negligent<br />

to believe that mobile data<br />

traffic will decrease again as the<br />

vaccines roll out and the world<br />

returns to "normalcy." Slow networks<br />

have simply become unacceptable.<br />

All operators are working<br />

flat out to provide users with<br />

better, faster networks. In many<br />

ways, the pandemic has been the<br />

catalyst to accelerate 5G infrastructure<br />

and deployment.<br />

Short-term Impact<br />

Because it is an application-based<br />

technology, we won't know the<br />

full benefits of 5G until it is<br />

source ©: Deutsche Telekom AG<br />

*Tom Leddo is Chief Strategy Officer of MD7, a mobile infrastructure solutions company based in San Diego. 73


<strong>Smart</strong> Lifestyle Mobile Services<br />

7.6<br />

The 5G Readiness Index 2021: Europe is Falling behind<br />

6.1<br />

5.8 5.6 5.6 5.3 5.1 5.0 5.0 4.9 4.7 4.7 4.6<br />

4.3 4.1 4.0 4.0 3.9 3.7<br />

source ©: Deutsche Telekom source ©: Kearney analysis<br />

United States<br />

South Korea<br />

Norway<br />

Japan<br />

Singapore<br />

Switzerland<br />

Beamforming<br />

New aktive antenna technology brings better reception and higher data rates<br />

Passive antenna<br />

Active antenna<br />

Reception evenin<br />

outlying areas<br />

thanks to adjusted<br />

beam signal.<br />

Signals radiate<br />

evenly in all<br />

directions<br />

Signal weaker at<br />

the edge<br />

Individually<br />

controllable signals<br />

can be targeted<br />

Signal is just as strong in<br />

the peripheral area as in the center<br />

Client only uses<br />

telephone, requiring<br />

less bandwidth<br />

Finland<br />

Italy<br />

Unready in Europe<br />

The 5G Readiness Index<br />

reveals that Europe is<br />

falling behind. But 5G<br />

isn't just an upgrade, but<br />

a paragym shift that will<br />

unleash innovation and<br />

new business ideas leaving<br />

latecomers playing<br />

catch-up.<br />

Adjustable<br />

transmitting<br />

power<br />

Perfect coverage <br />

for every single customer<br />

(maximum cell throughput)<br />

China<br />

Netherlands<br />

Sweden<br />

Australia<br />

Denmark<br />

France<br />

tions will not disappear when<br />

the next generation of mobile is<br />

implemented. Rather, they will experience<br />

a performance boost under<br />

5G, such as faster downloads,<br />

improved streaming and gaming,<br />

or more reliable video conferencing.<br />

Mobile operators which can<br />

take advantage of this difference<br />

Horizontal and vertical<br />

antennaadjustment increases<br />

coverageespecially in urban areas<br />

withhighrise buildings.<br />

Signal is only<br />

transmitted<br />

when needed<br />

Client streams video<br />

at high data rates.<br />

Signal is adjusted as<br />

necessary<br />

Germany<br />

Spain<br />

United Kingdom<br />

Austria<br />

Belgium<br />

"here," which will take another<br />

five to ten years. Until then, we<br />

see two types of near-term impact:<br />

How existing applications<br />

work on 5G networks and how 5G<br />

impacts the economy even as it is<br />

being deployed.<br />

Even though 5G is applicationbased,<br />

today's mobile applicawill<br />

definitely be among the winners<br />

of the development.<br />

The other angle from which to<br />

look at the short-term impact of<br />

5G, is the benefit to the economy.<br />

According to a study conducted<br />

for the U.S. by the Boston Consulting<br />

Group, 5G will contribute<br />

between $400 billion and $500<br />

billion to the gross domestic<br />

product there and create up to<br />

one million new jobs by 2030.<br />

Even if these figures already seem<br />

impressive: The economic impact<br />

of a new mobile network has already<br />

been underestimated at<br />

least once. Studies at the beginning<br />

of 4G deployment, for example,<br />

assumed that investment<br />

in 4G networks in the U.S. would<br />

contribute about $73 billion to<br />

$151 billion to GDP from 2012<br />

to 2016 and create 371,000 to<br />

771,000 new jobs. By 2016, however,<br />

4G contributed nearly $445<br />

To Beam or not to Beam?<br />

Instead of emitting a mobile<br />

signal in a circular pattern,<br />

which then becomes weaker<br />

and weaker at the edges, as<br />

has been the case in the past,<br />

beamforming allows 5G signals<br />

to be targeted in the form of<br />

elongated lobes. This means<br />

that the transmission power can<br />

be adjusted as needed.<br />

74


The 5G Economy<br />

will go through three phases,<br />

says the Boston Consulting<br />

Group. Robust 5G networks<br />

will serve as the backbone<br />

of future economic growth.<br />

Rising 5G penetration rates<br />

will enable transformation in<br />

existing applications. Phase<br />

three will bring benefits to<br />

citizens and businesses<br />

including higher productivity,<br />

lower costs, and better health<br />

and safety.<br />

Broad<br />

benefits<br />

5G -enabled<br />

use cases<br />

5G will be the Foundation for Tomorrow's Economy<br />

A robust 5G network will bring significant direct benefits:<br />

• More data, more devices, and increased speed<br />

• A better network experience for US citizens and businesses<br />

source ©: Boston Consulting Group<br />

billion to GDP. Over the course<br />

of the "4G decade," more than 20<br />

million jobs were created in the<br />

U.S. alone.<br />

In this sense, the true impact of<br />

5G is likely to be much higher<br />

than we are currently outlining.<br />

A Look at the Potential<br />

While the near-term impact of 5G is<br />

quantifiable in terms of application<br />

performance and GDP growth, it<br />

still does not take into account the<br />

broader effect of the 5G ecosystem.<br />

For 5G to truly take hold, the<br />

industry must demonstrate the<br />

technology's "business case." Why<br />

else would investment continue to<br />

flow into the sector? How to develop<br />

use cases for 5G without using<br />

5G? It's the ultimate chicken-andegg<br />

scenario. So which comes first,<br />

the technology or the application?<br />

With 4G, it was the technology.<br />

Application versus network was<br />

never an issue with 4G because<br />

4G was content-driven. Consumers<br />

wanted faster speeds to<br />

stream movies, go online and<br />

generally use mobile Internet.<br />

However, while 4G was a big step<br />

Fixed Wireless<br />

Access<br />

Leveraging the improved speed and<br />

performance of 5G to offer broadband<br />

to homes and businesses<br />

Robust<br />

5G network<br />

The Different Rationales for Deploying 5G<br />

Enhanced<br />

Mobile<br />

Broadband<br />

Offering a better and more unique<br />

user experience-often including<br />

tailored content and services<br />

Near term<br />

forward for the way mobile users<br />

consume content, the technology<br />

didn't break through until<br />

the emergence of certain applications.<br />

Through them, developers<br />

learned what the technology<br />

could do and products and services<br />

emerged, such as Uber, that<br />

used 4G to transmit data and locations<br />

- and changed our lives.<br />

With 5G, it's very different. Unlike<br />

4G, 5G lacks a fundamental network<br />

for developers to even begin<br />

developing applications. That's<br />

because we don't yet know what<br />

5G can really do. We also don't<br />

know how applications will use<br />

the near-zero latency and IoT capabilities.<br />

As a result, it's impossible<br />

to assess the true impact of 5G.<br />

Network Cost<br />

Optimization<br />

Meeting network traffic demands in<br />

a more cost-effective manner than<br />

building new cell sites<br />

The business case depends on multiple factors, including market needs, technology options, the existing<br />

(and expected) competitive landscape, marketing strategies, and tailored content<br />

Who Will Lead in 5G?<br />

By the end of the 2G era,<br />

spectrum-related regulations<br />

increased licensing<br />

costs and delayed investment<br />

in 3G in Europe, so<br />

Japan dominated and<br />

was well-positioned to<br />

lead the 4G economy,<br />

too. During both the 2G<br />

and 3G eras, the US was<br />

slow to roll out networks.<br />

However, US regulators<br />

made important policy<br />

decisions, and by 2015,<br />

over 50 percent of adults<br />

in both the US and Japan<br />

had 4G subscriptions—a<br />

higher percentage than in<br />

most European countries.<br />

It remains to be seen who<br />

will lead the 5G revolution.<br />

New Use Cases<br />

Moving beyond core connectivity with<br />

newusecases(verticalor horizontal)<br />

and business models (mostly B2B and<br />

B2B2C)<br />

Long term<br />

5G-enabled use cases are key to building the 5G economy:<br />

• Extreme mobile broadband<br />

• Fixed wireless access<br />

• Massive loT (consumer wearables, logistics and tracking)<br />

• Mission-critical loT (e-health, connected vehicles)<br />

Broad societal benefits will include:<br />

• Improved productivity<br />

• Improved cost competitiveness for US companies<br />

• Improved health and safety<br />

The theoretical possibilities are<br />

endless. At its core, 5G is about real-time<br />

connectivity and connecting<br />

everything to everything – the<br />

basic promise of IoT, after all.<br />

Once the first business model is<br />

established that leverages the capabilities<br />

of 5G, the ROI will likely<br />

be greater than anyone is predicting<br />

today. Just as Uber created a<br />

ride-sharing market that would<br />

have been impossible without 4G,<br />

companies that listen wisely to<br />

their customers can find the next<br />

big niche with the help of 5G.<br />

The Next Big Thing<br />

Each new generation of technology<br />

has brought improvements<br />

with faster and more reliable connections.<br />

Since the introduction of<br />

4G/LTE, mobile has changed the<br />

way people work, live, get around,<br />

or spend their leisure time. But<br />

where those advances were already<br />

astronomical, 5G will far<br />

eclipse them. No one can predict<br />

what the future will bring, but the<br />

limitless potential of 5G is beyond<br />

question. All that remains to be<br />

seen is how, when, and by whom<br />

this technology's enormous potential<br />

will be fully realised.<br />

source ©: Boston Consulting Group<br />

75


<strong>Smart</strong> Lifestyle Interview: Chetan Khona<br />

I bet these last few months have<br />

been an exciting time to work for<br />

Xilinx.<br />

Yeah, Tim, it sure is. Recently,<br />

we’ve doubled down on our<br />

products geared for my segment<br />

of the market: industrial vision,<br />

healthcare and sciences. And, if<br />

you haven't noticed, we've announced<br />

about five years’ worth<br />

of products for industrial and<br />

healthcare IoT edge applications<br />

in the past few months.<br />

Interview<br />

The World<br />

is Shrinking<br />

Computer chips are more powerful and versatile than ever<br />

and they're getting smaller every day. A company making<br />

this happen is Xilinx, based in San Jose, California,<br />

and it is one from just a handful of innovators shaping<br />

the future of semiconductors. The inventor of the field<br />

programmable gate array (FPGA) has just been acquired<br />

by microprocessor giant AMD for the staggering sum<br />

of $35 billion. <strong>Smart</strong> <strong>Industry</strong> sat down with<br />

Chetan Khona, Director, Industrial, Vision,<br />

Healthcare & Sciences at AMD.<br />

n By Tim Cole *<br />

source ©: TIM Global Media BV<br />

So, you already have your work cut<br />

out for you for the next five years.<br />

Yes, absolutely. We just announced<br />

our cost-optimised portfolio<br />

at 16 nanometers, our Artix<br />

UltraScale+ in our extensions towards<br />

Zynq UltraScale+ devices<br />

that are amazingly popular in industrial<br />

healthcare IoT systems. In<br />

April of this year, we introduced<br />

our Kria system-on-modules that<br />

enable developers to programme<br />

and differentiate their designs at<br />

the software level, without requiring<br />

FPGA programming experience.<br />

Then, in June of this year,<br />

we announced our Versal AI edge<br />

products for people who don't<br />

really know what FPGAs are. It’s<br />

an Adaptive Compute Acceleration<br />

Platform (ACAP) for real-time<br />

systems in automated driving,<br />

predictive factory and healthcare<br />

systems, multi-mission payloads<br />

in aerospace and defense, and a<br />

breadth of other applications.<br />

Could you explain what role they<br />

play in the development of IoT systems?<br />

Sure, adaptive system-on-a-chip,<br />

or SoC FPGA for short, is what our<br />

Zynq and Zynq UltraScale+, and<br />

now our Versal AI edge devices<br />

offer: processing at the IoT edge,<br />

right at the analog digital boundary.<br />

They enable scalability from<br />

low to mid to high-end systems<br />

but also allow you to keep running<br />

software on a consistent<br />

Arm processing subsystem. In addition,<br />

they have customised acceleration<br />

blocks for a variety of<br />

76<br />

*Tim Cole is editor of <strong>Smart</strong> <strong>Industry</strong>.


applications ranging from things<br />

like electric drive to patient monitors<br />

and security cameras, all with<br />

the same device. We call this ‘platform<br />

design’ and platforms are<br />

critical to industrial and healthcare<br />

IoT design.<br />

What is FPGA DNA?<br />

When we say FPGA DNA, we are<br />

referring to the fact that, even<br />

though we have systems-onchips,<br />

what separates ours from<br />

traditional SoCs supplied by other<br />

semiconductor manufacturers<br />

is that, in addition the usual set<br />

of status-quo features, we also<br />

offer fabric FPGAs to go along<br />

with them. In the past, you’ve often<br />

seen a processor sitting next<br />

to an FPGA, now you essentially<br />

are getting the functions of both<br />

devices in one because we've<br />

brought the FPGA and the processor<br />

together under one hood.<br />

You mentioned platforms. Why are<br />

they critical in situations like this?<br />

Xilinx has identified a few key<br />

pieces that are used in virtually all<br />

industrial and healthcare IoT systems;<br />

things like functional safety,<br />

cybersecurity, connectivity, control,<br />

vision, mixed criticality, embedded<br />

software and edge AI. These are<br />

pieces that are used in almost all<br />

new industrial and healthcare IoT<br />

designs. If you have to start designing<br />

from scratch every time, you<br />

might have a product out by the<br />

end of the decade, so good luck to<br />

you! But the platform concept helps<br />

you to be more efficient by re-using<br />

blocks and leveraging your investment.<br />

When you mix the scalability<br />

of Xilinx SoCs with this platform in<br />

concept, you get what a lot of our<br />

customers would feel is a winning<br />

combination.<br />

The semiconductor world is moving<br />

quickly to things like miniaturisation,<br />

lower power, lightweight<br />

or even entirely wireless. What can<br />

Xilinx bring to the table here?<br />

You're so right! I mean, no one out<br />

there is selling products that are<br />

bigger, slower or require more<br />

power. The world in all aspects of<br />

life is moving to smaller, lighter,<br />

wireless and battery power. In the<br />

short term, there is this concept<br />

of compute density that we're<br />

really focused on. As more and<br />

more processing is moving to<br />

the extreme edge, to the analog/<br />

digital boundary, compute density<br />

increasingly becomes a bigger<br />

deal. That's something we've<br />

tapped into with InFO packaging<br />

in the cost-optimised portfolio<br />

extensions that we have just announced.<br />

Tell us something about integrated<br />

fan out. What is it and why should<br />

customers be interested?<br />

I wouldn’t recommend your readers<br />

try this at home but if you<br />

were to crack open your mobile<br />

phone – and maybe you have<br />

one, you know, with a fruit logo<br />

on it – you'll see examples of InFO<br />

packaging in action. Integrated<br />

fan out eliminates the substrate<br />

that acts as the interconnect between<br />

the dye and the balls that<br />

connect up to the printed circuit<br />

board. What this means is that<br />

you're getting the most compute<br />

density per square millimetre of<br />

any embedded processor on the<br />

planet without reducing IO count.<br />

Typically speaking, you're going<br />

to see 60 percent smaller size, 70<br />

percent lower height, with zero<br />

IO loss. Having that kind of computational<br />

horsepower in something<br />

smaller than the size of your<br />

fingernail is an absolute game<br />

changer for many industries.<br />

You know, that sounds like the end<br />

of the road for chip miniaturisation,<br />

doesn’t it? How can you possibly<br />

get any smaller?<br />

Well, this is independent from the<br />

natural scaling that takes place,<br />

right? Even though Moore's Law<br />

has slowed down slightly over<br />

time, that doesn't mean that geometries<br />

aren’t still shrinking.<br />

Right now, our 16 nanometer<br />

products are probably main-<br />

Just because<br />

Moore's Law<br />

has slowed<br />

down slightly<br />

doesn't mean<br />

geometries<br />

aren't still<br />

shrinking.<br />

Chetan Khona<br />

AMD<br />

stream for many applications, but<br />

we've announced products, many<br />

of which are already entering into<br />

full-ramp production, that work<br />

at seven nanometers, and the<br />

world is shrinking even more.<br />

If the dye shrinks even further,<br />

the InFO packaging will have to<br />

shrink along with it.<br />

You were personally involved in<br />

the Xilinx solution approach. What<br />

is your primary focus and what are<br />

your core vertical markets?<br />

At Xilinx, we have eight markets<br />

that we’re really focused on,<br />

namely wired and wireless communication,<br />

data centres, automotive,<br />

aerospace and defense,<br />

test and measurement, audiovideo<br />

broadcast, consumer<br />

electronics, and then my market<br />

which is industrial vision, healthcare<br />

and sciences which makes<br />

up almost 40 percent of the total<br />

number of customers Xilinx has<br />

out there.<br />

You are partnering with Avnet<br />

Silica, the sponsors of this magazine<br />

and the corresponding podcast,<br />

We Talk IoT, in which you’ve<br />

already appeared. What is Avnet’s<br />

role in your go-to-market process?<br />

As we touched on when you<br />

asked about the ecosystem, we're<br />

fortunate to have partners, and in<br />

this case Avnet Silica, as a close<br />

cooperative partner with whom<br />

we can generate clear value for<br />

customers on a daily basis. They<br />

do the distribution and financial<br />

services, support and upfront<br />

architectural advisement for customers’<br />

design services, from the<br />

chip to the board to connectivity<br />

to the cloud. They do the training<br />

and events that draw a lot<br />

of people, whether in person or,<br />

these days especially, online but<br />

most importantly for us, they're a<br />

trusted partner that our customers<br />

think of first and can count<br />

on even in such uncertain times.<br />

I would say they are the key player<br />

in my own business go-to-market<br />

process.<br />

77


<strong>Smart</strong> Solution Data Marketplaces<br />

Data Marketplaces<br />

Old Data for<br />

Sale<br />

Do you know what your data is worth? Many private<br />

companies and public sector organisations could be sitting on<br />

piles of money they could use for other purposes– but where can<br />

they go to buy, sell or exchange this ‘used’ data? Data exchanges<br />

are an exciting new frontier in the realm of Big Data.<br />

n By Stian Overdahl<br />

78


Data exchanges, or data<br />

marketplaces, could potentially<br />

unlock new revenue<br />

streams for companies,<br />

as well as lowering the cost of engaging<br />

in data-intensive activities,<br />

such as training machine-learning<br />

algorithms. Aside from exchanges,<br />

white label solutions for large corporates<br />

and their suppliers are another<br />

promising development.<br />

Any company can estimate the<br />

value of its data by calculating the<br />

cost of collecting it, its value to an<br />

internal commercial project, and<br />

its quality and longevity (will it<br />

have value in five years’ time?). In<br />

the era of data exchanges, these<br />

figures take on a new cogency<br />

as companies sell data sets, give<br />

them to trusted partners or acquire<br />

new data sets.<br />

Establishing a value for data on a<br />

public marketplace could bring<br />

big benefits to companies. For<br />

example, a project generating a<br />

significant amount of data could<br />

defray some of its costs by selling<br />

it, while a project where collection<br />

costs are significant could be done<br />

more cheaply by buying-in data.<br />

Sheridan Johns, head of ecosystem<br />

at Ocean Protocol, a blockchain-based<br />

data exchange, says,<br />

“People understand that data is<br />

valuable, and people are building<br />

valuable companies using data,<br />

but what are people going to<br />

pay for data? Putting data on our<br />

marketplace, allowing data to be<br />

Data<br />

Provider<br />

Compute<br />

Provider<br />

of digital and emerging technology<br />

at professional services firm EY.<br />

Buyers of raw data often find that<br />

suppliers collect and aggregate<br />

data in different ways and formats.<br />

A company that wants to<br />

provide a weather service, for example,<br />

can run into difficulties as<br />

it must obtain data from various<br />

measuring sites.<br />

It’s likely that a weather station<br />

run by a professional organisation,<br />

like an airport, would collect<br />

data more frequently, whereas<br />

others, such as a community organisation,<br />

would sample less frequently.<br />

In addition, the various<br />

measurers may calibrate their sensors<br />

differently. Maintenance can<br />

also be a factor – for example, one<br />

supplier may experience more<br />

downtime or it may decide to<br />

upgrade its software, making the<br />

data fragmented or unreadable.<br />

There are also questions about<br />

whether a company can build a<br />

product with a competitive advantage<br />

by relying on third-party data<br />

sources, or does it need to build its<br />

own sensing infrastructure?<br />

“In 99 percent of cases, you will<br />

recognise that the competipriced<br />

in real time using dynamic<br />

pricing features and automatic<br />

market makers, enables an individual<br />

or organisation to publish<br />

a certain dataset and determine<br />

exactly what its value is.”<br />

Johns believes that within ten<br />

years it’s going to be commonplace<br />

for large organisations to be<br />

either buyers or sellers of data using<br />

online data marketplaces. This<br />

potential growth will result from<br />

the growing need for data, especially<br />

for artificial intelligence.<br />

Increased demand and a growing<br />

awareness of the importance of<br />

data also makes companies more<br />

likely to share externally, notes Didier<br />

Navez, senior vice president of<br />

strategy and alliances at Dawex, a<br />

data exchange. “In the context of<br />

training AI, it seems like the market<br />

is evolving and maturing, and<br />

companies are really willing to<br />

share data. Clearly data exchanges<br />

help in that process because they<br />

provide a structured environment<br />

where exchange of data is secure<br />

and compliant,” he says.<br />

There are still several flies in the<br />

ointment, especially in the domain<br />

of IoT: quality of data, privacy<br />

and commercial sensitivities.<br />

"When it comes to monetisation<br />

of IoT data, people think it should<br />

be easy. Unfortunately, there are<br />

a couple of huge issues and this<br />

concept very quickly becomes<br />

very complicated,” says Aleksander<br />

Poniewierski, global head<br />

Decentralized Data Market Protocol and Network of AI Data / Servies<br />

Storage<br />

Provider<br />

Analytics<br />

People understand<br />

that data<br />

is valuable, but<br />

what are they<br />

going to pay?<br />

Sheridan Johns<br />

Ocean Protocol<br />

Further<br />

Processing<br />

source ©: New Work SE<br />

source ©: Asia Crypto Today<br />

Algorithm<br />

f(x)<br />

Curation<br />

Building a Data Ecosystem<br />

Through the help of decentralised service<br />

agreements and access controls powered<br />

by virtual machines, Ocean allows users<br />

to access, monetise, and even curate data<br />

management services that they will need<br />

for their businesses.<br />

79


<strong>Smart</strong> Solution Data Marketplaces<br />

tive advantage comes from building<br />

your own data infrastructure,<br />

rather than sourcing [externally],”<br />

says Poniewierski. If a company<br />

creates a business that relies on<br />

external data sources, then competitors<br />

might easily surpass it, he<br />

notes.<br />

Putting Data to Good Use<br />

Exchange operators embrace a<br />

range of different models, ranging<br />

from fully open data marketplaces,<br />

through restricted marketplaces<br />

or corporate internal data sharing<br />

platforms, to data brokers that will<br />

search for a data set on request.<br />

There is also the split between private<br />

and public sectors. For example,<br />

several public sector organisations<br />

have a mandate to share data<br />

sets and a marketplace is one way<br />

to make these more readily available.<br />

One such project, Gaia-X in<br />

Europe, envisages a marketplace<br />

to improve artificial intelligence<br />

product development, including a<br />

“protected data room for development<br />

and test data in order to continuously<br />

improve the AI applications<br />

and adapt them to customer<br />

needs”.<br />

Long-running fears about personal<br />

data privacy means there is now<br />

the potential for forming decentralised<br />

autonomous organisations<br />

80<br />

The advantage<br />

comes from<br />

building your<br />

own data infrastructure.<br />

Aleksander Poniewierski<br />

Global head of digital<br />

and emerging technology<br />

at EY<br />

Purchasing Platform<br />

<strong>Smart</strong> Contracts by<br />

Databroker DAO is a<br />

platform for listing,<br />

verifying, aggregating,<br />

enhancing and<br />

reselling data through<br />

a simple and intuitive<br />

user interface.<br />

(DAOs) where individuals could<br />

share their own anonymised data<br />

with others.<br />

“What we’re seeing emerging on<br />

the consumer front is the idea of<br />

data unions, or data DAOs, where<br />

individuals are encouraged to pool<br />

their data into one larger data set.<br />

Then, when that data set is used<br />

by the third party, the rewards are<br />

distributed to all of the individuals<br />

who helped to make it,” says Johns.<br />

source ©:EY / Ernst & Young Global Limited<br />

White-label solutions target organisations<br />

where commercial sensitivity,<br />

privacy and other concerns<br />

are top of mind. These allow data<br />

sets to be shared securely between<br />

business units within the organisation<br />

or with trusted supply-chain<br />

partners.<br />

In the enterprise segment, the advantages<br />

of sharing data may outweigh<br />

commercial sensitivities. In<br />

the German automotive industry,<br />

companies – including Mercedes-<br />

Benz, BMW and Volkswagen – are<br />

exploring the potential benefits<br />

of a data exchange programme.<br />

The goal is an open, scalable network<br />

for sharing cross-company,<br />

standardised information. As a<br />

technology partner, Ocean Protocol<br />

describes the basic concept as<br />

showing how competitive companies<br />

can benefit mutually by sharing<br />

data rather than building separate,<br />

proprietary, siloed services for<br />

themselves.<br />

Financial opportunities will depend<br />

on the value companies<br />

see in the data they obtain on exchanges,<br />

and what they’re willing<br />

to spend. In turn, that depends on<br />

how the data can improve business<br />

outcomes – and its quality.<br />

source ©: Medium


Interview<br />

Circular Reasoning<br />

What is Dawex?<br />

Dawex helps facilitate the circulation<br />

of data among various stakeholders.<br />

We are developing data<br />

exchange platforms that can be<br />

used by many different types of<br />

organisations, whether private or<br />

public.<br />

Why are data exchanges important?<br />

As you know, the world is seeing<br />

an explosion in data being created.<br />

IoT is part of the reason but,<br />

even though the supply of data is<br />

incredibly high – activities such<br />

as training a machine learning algorithm<br />

requires huge amounts<br />

of data – demand is increasing a<br />

lot, more than a single organisation<br />

can typically supply. Organisations<br />

need to look to external<br />

sources. Of course, you have open<br />

data, you can scrape the web and<br />

do things like that but very often<br />

the most important data are residing<br />

at other organisations – accessing<br />

that can be challenging,<br />

at least legally.<br />

So that’s where data exchanges<br />

come in?<br />

They connect the data suppliers<br />

with the data acquirers and help<br />

them engage. That requires trust.<br />

Elements that can create trust<br />

include being able to carry out a<br />

data transaction in a secure and<br />

regulatory compliant environment<br />

– something you can typically<br />

embed in a data exchange<br />

platform.<br />

Can I buy used data like I buy a<br />

used car? Does it belong to me?<br />

Data owners must consider<br />

whether they are ready to make<br />

their data available to others and,<br />

if so, on which terms and conditions,<br />

and at what price. Typically,<br />

data is licensed. Instead of buying<br />

the data outright, the buyer<br />

purchases a license which allow<br />

them to use it under certain<br />

terms and conditions. There are<br />

also many regulations governing<br />

data sales – not just private data,<br />

but any kind of data. We know of<br />

more than 120 pieces of regulation<br />

globally and our anticipation<br />

is that the data economy is going<br />

to be regulated as heavily as the<br />

financial markets – if not more so.<br />

What are the technical requirements?<br />

The actual sharing and transferring<br />

of data can happen in many<br />

ways: simple, file-based exchange<br />

or API-based; it can be a one-time<br />

transaction versus subscription<br />

or ongoing. With a subscription<br />

the user obtains access to data<br />

Data owners<br />

must always<br />

know who they<br />

are dealing<br />

with, who is<br />

using the data,<br />

and how it will<br />

be used.<br />

Didier Navez<br />

Dawex<br />

source ©: Dawex Systems<br />

for a certain period, with the data<br />

updated on a regular basis according<br />

to the agreement. The<br />

challenge and opportunity for<br />

the data exchange provider is to<br />

be able to keep track of, and cope<br />

with, all these use cases and scenarios.<br />

At Dawex, we manage all<br />

these issues, whether it’s a hedge<br />

fund making a one-off acquisition<br />

of a data set to test an algorithm,<br />

or on-going projects, for example<br />

in the agricultural sector and in<br />

the agri-foods industry.<br />

In September 2021, you joined<br />

a consortium of partners from<br />

the aerospace industry to create<br />

what you call the Space Data<br />

Marketplace. What is the rationale<br />

behind that?<br />

This project is focused on satellite<br />

data. Currently, the domain<br />

is quite siloed. There are multiple<br />

sources where you can get<br />

these data now but it’s neither<br />

very streamlined nor efficient. We<br />

want to create a one-stop shop<br />

for all types of satellite data for<br />

all kinds of use cases and initiatives.<br />

For example, we have companies<br />

developing solutions for<br />

analysing infrastructure using AI<br />

or looking at applications such<br />

as rail or waterways or managing<br />

crops and vegetation.<br />

What’s the difference between<br />

open exchanges and closed<br />

white-label ecosystems, and<br />

how do you see this playing out?<br />

A modern data exchange environment<br />

should push for transparency,<br />

so the data owner will always<br />

know who they are dealing with,<br />

who is using the data and how<br />

it will be used. That’s a very important<br />

principle for augmenting<br />

the trust that corporates have for<br />

making their own data available<br />

to others and, for example, avoiding<br />

the chance that a competitor<br />

would be able to access sensitive<br />

data they shouldn’t have.<br />

81


<strong>Smart</strong> Solution Machine Vision<br />

Machine Vision<br />

How to See<br />

the World<br />

Machines aren’t just becoming smarter every day –<br />

they are also developing the ability to see the world around them.<br />

In fact, artificial eyes can penetrate to greater depths and<br />

pick out much more detail than our weaker human eyes can<br />

ever hope to see. And yes, they can see in the dark, too.<br />

For IoT applications, this could be a real eye-opener.<br />

n By John Koon<br />

82


Light detection and ranging<br />

(Lidar) is a remote sensing<br />

method that uses pulsed laser<br />

light to measure ranges<br />

(variable distances). Similar to its<br />

close cousins, radar using radio<br />

waves and sonar emitting sound<br />

waves under water, Lidar uses laser<br />

light to accurately measure ranges<br />

(distances) – something that is critical<br />

for many sectors and industrial<br />

processes.<br />

Theoretically, measurement can be<br />

performed using other technologies,<br />

but Lidar has multiple advantages<br />

over them. For example, it has<br />

a higher resolution than radar and<br />

a wider range than camera sensors<br />

and can even perform in the dark.<br />

Furthermore, Lidar produces 3D<br />

data and can detect and differentiate<br />

objects. As a result, it can be used<br />

to track objects, detect physical protrusions<br />

and survey landscapes.<br />

Measuring carbon dioxide, sulfur<br />

dioxide and methane in the air or<br />

water can also be achieved with<br />

Lidar, making it ideal for things like<br />

geographical surveys, autonomous<br />

driving, industrial applications and<br />

logistics.<br />

source ©: NOAA<br />

The Face of the Earth<br />

Geographical surveys are not just<br />

for mapping mineral and water<br />

resources, they have been used to<br />

map zones prone to earthquakes,<br />

tsunamis, landslides, flooding and<br />

volcanic activity to deal with potential<br />

disasters. In addition, coastlines<br />

need to be surveyed for effective<br />

management and planning for<br />

navigational, environmental and<br />

homeland security purposes.<br />

As global warming raises sea levels<br />

and causes extreme weather events<br />

like enormous floods and droughts,<br />

high-resolution geographical surveys<br />

will be crucial for monitoring<br />

the effects of global warming, such<br />

as coastline erosion. This information<br />

can help governments to devise<br />

coping strategies, such as safe<br />

and responsible land use and emergency<br />

preparedness, to protect civilian<br />

lives and marine wildlife.<br />

The National Oceanic and Atmospheric<br />

Administration (NOAA), an<br />

agency primarily responsible for<br />

mapping US shorelines, sought to<br />

increase the efficiency and reduce<br />

the subjectivity of older technologies,<br />

such as tide coordinated aerial<br />

photography. Data collection in intertidal<br />

zones was also poor because<br />

these areas are too shallow for<br />

survey vessels to approach safely.<br />

NOAA now uses airplanes and helicopters<br />

equipped with two types of<br />

Lidar: topographic and bathymetric.<br />

Topographic Lidar typically uses a<br />

near-infrared laser to map the land,<br />

while bathymetric Lidar uses waterpenetrating<br />

green light to measure<br />

seafloor and riverbed elevations.<br />

Lidar is helping<br />

us understand<br />

sea-level rises<br />

and coastal<br />

flooding/inundation<br />

impacts,<br />

and marine life<br />

habitat mapping.<br />

Stephen White<br />

NOAA<br />

National Ocean Service<br />

Monitoring<br />

the Warming<br />

A view looking northeast<br />

from Virginia Key<br />

shows the topobathymetric<br />

surface of the<br />

intertidal zone near<br />

Fisher Island. This<br />

image was created<br />

from the LiDAR bare<br />

earth model colored<br />

by elevation.<br />

The two images can be combined to<br />

produce a single ‘topobathymetric’<br />

image of the coastal area.<br />

Driving Force<br />

How do we make sure autonomous<br />

cars and trucks pay proper attention<br />

and avoid disasters in near<br />

darkness, pouring rain, heavy snow<br />

or on a winding road?<br />

Lidar’s high speed and accuracy enable<br />

distant object detection on a<br />

moving vehicle, even in low light.<br />

This makes it a powerful technology<br />

for advanced driver-assistance<br />

systems (ADAS) in drones and vehicles.<br />

It performs less well in heavy<br />

rain and snow or in fog but work is<br />

in progress to find ways to improve<br />

its reliability in all but the worst conditions.<br />

Earlier Lidar technologies were<br />

typically used in applications with<br />

a high tolerance for failure. In contrast,<br />

the bar is much higher for<br />

safety, accuracy, and reliability<br />

when using it in autonomous vehicles.<br />

Products need to be designed<br />

from scratch to meet the 3D sensing<br />

requirements of automotive active<br />

safety systems, ADAS implementations<br />

and autonomous vehicles. In<br />

addition, solutions must be small<br />

and unobtrusive which is a challenge<br />

for Lidar.<br />

83<br />

source ©: NOAA


<strong>Smart</strong> Solution Machine Vision<br />

Aerial Mapping<br />

YellowScan uses<br />

a mix of dronemounted<br />

passive<br />

and active laser<br />

sensors to create<br />

3D maps for mining,<br />

civil engineering,<br />

forestry, environmental<br />

research,<br />

and archeology.<br />

Passive Sensor<br />

Active Sensor<br />

source ©: MicroVision<br />

source ©: YellowScan<br />

The scan rates and angles of the<br />

sensor need to be dynamically controlled<br />

and limiting the number of<br />

sensors used helps to decrease overall<br />

cost. It also minimises the amount<br />

of high-resolution data that must be<br />

collected and analysed on an often<br />

fast-moving and sporadically accelerating<br />

and decelerating vehicle.<br />

Vehicles need to<br />

see further out<br />

and understand<br />

more about<br />

what they see,<br />

such as which<br />

objects are<br />

moving and<br />

where are they<br />

heading.<br />

Jari Honkanen<br />

MicroVision<br />

The latest high-resolution 3D systems,<br />

such as MicroVision’s Long<br />

Range Automotive Lidar, meet stringent<br />

3D sensing requirements. They<br />

are compact and non-intrusive,<br />

with fast frame rates and can characterise<br />

an environment more accurately<br />

with a higher level of information<br />

analysis. These features enable<br />

vehicles to respond more rapidly to<br />

obstacles and avoid them.<br />

Making Things Work<br />

Industrial applications for Lidar include<br />

things like manufacturing<br />

and robotics automation. Systems,<br />

such as Baraja’s Spectrum-Scan, are<br />

being deployed in mining vehicles<br />

to map locations and visualise environments.<br />

It can also help improve<br />

worker safety in mines and caves.<br />

Mines are often located in remote<br />

areas and underground, where<br />

pockets of lethal gases tend to accumulate.<br />

Methane is explosive, carbon<br />

dioxide and carbon monoxide<br />

are lethal to humans at high concentrations,<br />

and hydrogen sulfide<br />

is poisonous and highly flammable.<br />

Therefore, using laser light to detect<br />

gas pockets allows miners to deal<br />

with them promptly, keeping them<br />

safe and making their time in the<br />

mine more efficient.<br />

Just as Lidars image the 3D topography<br />

of the environment for<br />

autonomous vehicles, they can be<br />

used above ground to detect unwanted<br />

gas concentrations during<br />

gas mapping. For example, a methane<br />

leak can be detected by pointing<br />

a laser beam of a specific color<br />

Loggerhead Lighthouse<br />

This image is a topobathymetric<br />

point cloud colorised<br />

by intensity. This image was<br />

captured during a survey of<br />

the Dry Tortugas, and is the<br />

lighthouse on Loggerhead Key.<br />

source ©: NOAA<br />

84


An Eye on the Road<br />

source ©: Bridger Photonics<br />

Scientists have approached the challenges<br />

of determining range, angleand<br />

velocity in two ways: using radio waves<br />

and using laser light. Lidar, radar and<br />

sonar each have their benefits and<br />

deficiencies in autonomous vehicles.<br />

Google’s spin-off company Waymo and<br />

Aurora, which took over Uber’s ill-fated<br />

project, both use Lidar but have radar<br />

for support in foggy, rainy or snowy<br />

conditions to assist Lidar’s less-reliable<br />

results in extreme weather. Tesla uses<br />

ultrasonic sonar to map the environment<br />

and a front-facing radar.<br />

A Sentry in the Sky<br />

At least 2 percent of gas<br />

resources is wasted through<br />

leaks of methane. A drone-based<br />

laser-based Remote Methane<br />

Leak Detector (RMLD) by Physical<br />

Sciences might solve the problem.<br />

at the suspected location or along<br />

a survey line. Some of the laser<br />

light is absorbed by the target gas<br />

and the rest bounces back as a diffused<br />

beam. The Lidar receives the<br />

reflected beam, measures the light<br />

absorption and calculates the density<br />

of the leaking methane.<br />

This process generates geo-specific<br />

images of gas plumes that can be<br />

combined with satellite and other<br />

data to create a map illustrating the<br />

leak’s extent and location. The GPS<br />

coordinates of the map can quickly<br />

direct a maintenance crew to the<br />

leak. So far, ExxonMobil and SoCal-<br />

Gas have used Lidar gas-mapping<br />

technology to detect leaks.<br />

source ©: Baraja<br />

What Will the Future Bring?<br />

In all cases, high-definition cameras<br />

supplement and complement the<br />

other systems to add visual context.<br />

The color cameras also provide the<br />

ability to monitor traffic lights and<br />

read road signs, which is beyond<br />

the other three sensors. This is useful<br />

where emergency signs have<br />

been put out by emergency services<br />

or for roadworks that may not be<br />

mapped on satnav systems.<br />

Lidar sensors are being developed<br />

that are even more miniaturised<br />

and lighter so they can be used for<br />

unmanned aerial systems, such as<br />

drones performing geographical<br />

surveys. Meanwhile, reducing costs,<br />

increasing reliability and enhancing<br />

data resolution will be common<br />

goals for the next generation.<br />

We are also likely to see further democratisation<br />

of Lidar applications.<br />

For example, the low-performance<br />

3D Lidars appearing in smartphones<br />

are likely to be replaced by<br />

ones with higher resolution and<br />

processing. In short, Lidar will be<br />

more compact, more capable and<br />

lower cost.<br />

Lidar systems<br />

can accurately<br />

map and visualise<br />

surrounding<br />

hazardous environments<br />

increasing<br />

safety<br />

and efficiency.<br />

Jim Kane<br />

Baraja Industries<br />

■ Radar<br />

Radio detection and ranging, coupled<br />

with hi-res cameras, is an approved way<br />

for providing machines with ‘sight’. In<br />

1886, German physicist Heinrich Hertz<br />

demonstrated that radio waves are reflected<br />

by metallic objects. British scientists,<br />

spurred on by the militarization of<br />

Germany, used this property to develop<br />

radio-based detection and ranging in<br />

1935. Independently, Germany, the USA<br />

and Russia also developed radar systems<br />

in the following year or two. These<br />

systems were all designed to detect<br />

huge hunks of metal at sea or in the air<br />

and in the years since then refinements<br />

have been made to finesse the detection<br />

capabilities to include all manner of<br />

objects, including humans.<br />

■ Lidar<br />

In 1960 the invention of laser technology<br />

created a flurry of research<br />

activity to find uses for the powerful<br />

light beams. In 1961, a US scientist<br />

named Malcom Stitch, who worked<br />

for the Hughes Aircraft Corporation,<br />

introduced the first functional Lidar<br />

system but it wasn’t until the arrival of a<br />

commercially available global positioning<br />

system (GPS) using satellites and<br />

inertial measurement units (IMUs) in<br />

the late 1980s that accurate positional<br />

data became available.Lidar’s reach is<br />

constantly increasing. Currently, Aeva,<br />

based in Silicon Valley, is selling its 4D<br />

Lidar system on-a-chip which has a<br />

range of 500m.<br />

85


Column Bernd Schöne<br />

Liquid Software<br />

Wetware Revisited<br />

There was a time when ‘wetware’ was a<br />

geek word for the part of the body<br />

that computer scientists use to<br />

gather and modify their thoughts.<br />

But jargon moves on and the new<br />

buzzword is ‘liquid software’, which<br />

stands for a system that can be updated<br />

and modified at any time without<br />

interrupting its flow. So, it isn’t all that<br />

different from wetware, is it?<br />

Agreeing on a definition for the new<br />

buzzword, on the other hand, is tricky. If<br />

you ask me, it simply represents a cautious<br />

step forward, albeit in the right general direction,<br />

with many more to follow.<br />

Software for IoT has very specific requirements. The<br />

market is fast-moving, unit volumes are high, and<br />

prices are manageable. The need to transfer large<br />

amounts of data across device and network boundaries<br />

is essential – as is the distribution of updates.<br />

Without software that is up-to-date, seamless interaction<br />

between sensors (acquiring data), data centres<br />

(crunching data), decision-makers (evaluating<br />

data) and actuators (controlling data) is impossible<br />

– and, without it, so is IoT. It comes as no surprise that<br />

the concept of ‘liquid’ has caused quite a flurry since<br />

its introduction to IT in 2014, even though, or maybe<br />

because, no one can say precisely what it is.<br />

The water analogy helps us understand what it is<br />

everybody’s talking about – and why they’re so excited.<br />

Just as water will always find its way to a river<br />

Dams and dikes<br />

are barriers<br />

that keep water –<br />

and data – from<br />

flowing freely.<br />

Bernd Schöne<br />

is a veteran German Internet<br />

journalist and an expert on<br />

cybersecurity<br />

and the sea, data and applications should be<br />

able to flow steadily and independently to<br />

where they are needed throughout the<br />

IoT network. The latest software versions<br />

running individual IoT components<br />

should autonomously go with<br />

the flow, with error corrections and<br />

new features being automatically<br />

patched-in on the way.<br />

This is not a new concept. The internet<br />

itself, and the World Wide Web, have<br />

been connecting computer systems for<br />

years, and ‘patch days’ are as old as the<br />

first servers. Before now, automatic updates<br />

were always instigated by specific applications,<br />

such as a browser or an email programme.<br />

Everything else required actions by the user. That's<br />

about to change. In the future, streams of data, applications<br />

and updates will find their own way to<br />

their destinations without a single click of a mouse.<br />

So far so good but experience has taught us that<br />

where liquid flows are concerned, dikes and weirs<br />

are essential to the successful co-existence of water<br />

and people. No one knows this better than the<br />

inhabitants of Europe, who were hit by horrendous<br />

flooding in 2021. The Dutch know better than most<br />

how to handle water: After a devastating storm<br />

surge in 1953, they sealed off the entire country from<br />

the North Sea within 30 years.<br />

Weirs and dikes are barriers that keep water – and<br />

data – from flowing freely and out of control. In IT,<br />

86


malware and substandard sets of data play the role<br />

of storm surges and floods. They must be contained.<br />

Even today, there are already such barriers in place in<br />

many companies but these ‘dikes’ are usually there<br />

for economic reasons. Apple and Google, both pioneers<br />

of the liquid software idea, with products like<br />

Apple's Handoff (Continuity) service and Android’s<br />

Lollipop, are fighting doggedly for market share –<br />

but the days of data monopolies are over.<br />

Keeping your users locked up within the walls of<br />

your own company network is the direct opposite<br />

of liquid software. It takes away the key advantages<br />

for the user and puts the whole idea of liquidity in<br />

danger.<br />

In my opinion, IoT dams and weirs should not be<br />

built by stock market analysts and CEOs, but by CTOs.<br />

There should be a coherent technical need for barriers<br />

to minimise security issues. Sandboxing of unknown<br />

data is one way to minimise risks but clear requirements<br />

for structure and security checks for incoming<br />

updates and new applications would also help.<br />

Technically, this is no longer a problem for machine<br />

tools whose AI intelligence always assumes a defect<br />

is imminent, based on conspicuous fluctuations in<br />

measured parameters. These predictive systems can<br />

not only inform service departments, without being<br />

told to do so, but can also automatically determine<br />

the availability of spare parts and the maintenance<br />

personnel waiting in the background. Edge systems<br />

can then autonomously calculate the team’s arrival<br />

time and determine when things will be running<br />

smoothly once again. All this without the maintenance<br />

or security teams needing to pick up the<br />

phone or for an employee to send an email to alert<br />

them.<br />

The IT support world is full of data: information about<br />

traffic flow, the number of service vehicles on standby,<br />

the location and condition of necessary spare or<br />

replacement parts. All we need to do is unlock this<br />

treasure trove of information and let the data flow.<br />

When that happens, we’ll be amazed to find what opportunities<br />

we’ve been missing just because phone<br />

providers, internet service providers, equipment<br />

manufacturers and operators, service companies,<br />

and application distributors have been jealously<br />

protecting their sinecures instead of networking in a<br />

purposeful way.<br />

Today, service technicians have to identify themselves<br />

to the gatekeeper, even though their IDs may<br />

have been established long ago and the exact time<br />

of their visits would already have been noted in all<br />

the company's IT systems. Unfortunately, gatekeepers<br />

don’t know any of this. Too bad!<br />

Of course, nobody should jump blindly into the flow.<br />

As always, prudence and precautions are necessary.<br />

New management tools, like ‘scrum’ software which<br />

helps teams to learn from shared experiences, will<br />

make IT security easier to achieve – there’s still no<br />

substitute for the human brain if we want to take IoT<br />

to the next level. In the end, it means that someone<br />

has to accept responsibility for any system. But as for<br />

the software? Just let it flow.<br />

87


<strong>Smart</strong> Solutions <strong>Smart</strong> Sensors<br />

<strong>Smart</strong> Sensors<br />

<strong>Smart</strong> Eyes for IoT<br />

Technicians have been reluctant to<br />

use cameras for IoT because they were<br />

considered too expensive. That is now<br />

history. Today, CMOS sensors with<br />

respectable resolution cost only a<br />

few dollars and chips that deliver<br />

high-definition images are available<br />

for a little more. Thanks to AI, new<br />

integrated image signal processors<br />

(ISPs) are taking the strain off transmission<br />

networks and edge computing.<br />

88<br />

n By Bernd Schöne<br />

Cameras provide lots of data<br />

and the more data, the better<br />

they are. Unfortunately,<br />

that clogs up the communications<br />

channels. In addition, the<br />

images have to be prepared and<br />

processed which puts a strain on the<br />

computers in the system. Often, the<br />

normal TV frame rate of around 25<br />

frames per second is not enough, either.<br />

Manufacturing machines operate<br />

so fast that surveillance cameras<br />

have to deliver 60 or more images<br />

per second. Thanks to data reduction,<br />

the H.265 transmission format<br />

shrinks the amount of data and thus<br />

enables wireless operation – but<br />

H.265 is computationally expensive,<br />

which is a shortcoming for batterypowered<br />

devices.<br />

CMOS chips also have peculiarities.<br />

Most sensors produce a certain<br />

basic noise level, even in absolute<br />

darkness. These chips also inevitably<br />

contain a few defective pixels.<br />

No problem – there are correction<br />

programmes for that. In addition,<br />

the distances between camera and<br />

object are often small in IoT applications.<br />

Also, no problem – that's what<br />

wide-angle lenses are for, though<br />

they do tend to distort and suffer<br />

from vignette shadowing around<br />

the edges.<br />

If the image analysis determines<br />

whether labels on a bottle are correctly<br />

positioned, for example, image<br />

errors can confuse and deceive<br />

the analysis programme. Here, too,<br />

there are proven remedies. However,<br />

correction programmes put a<br />

strain on the camera CPUs because<br />

the correction is best done before<br />

the image has been compressed in<br />

order to achieve optimum results.<br />

This, in turn, puts further strain on<br />

the communications channels.<br />

Usually, in cheaper systems, the<br />

black-and-white image of the sensor<br />

has to be transformed into a color<br />

image. For this purpose, the mosaiclike<br />

pattern of color filters over the


Qoitech<br />

Fighting Power Hunger<br />

source ©: Qoitech AB, Elektor Verlag GmbH<br />

camera sensor has to be back-calculated,<br />

so to speak, in order to obtain<br />

red/green/blue color separations<br />

(demosaicing). This also costs computing<br />

power.<br />

A new generation of image signal<br />

processors (ISPs) now offers developers<br />

a solution to these problems.<br />

ISPs operate in the immediate vicinity<br />

of the camera module and handle<br />

all the pre-processing of the images.<br />

They are calibrated to the chip and<br />

its optics and transform the raw data<br />

into images that can be easily processed<br />

further.<br />

In reality, no one is interested in<br />

the camera images, only the results<br />

count – thumbs up or thumbs<br />

down. In the labeling example, the<br />

operator wants to know if the label<br />

is positioned correctly: is it crooked<br />

or, in the case of pharmaceuticals, is<br />

it stuck together in such a way that<br />

it’s no longer legible? When cleaning<br />

bottles, no one is interested in<br />

the 100,000 bottles that have been<br />

cleaned well but only in those that<br />

need to be cleaned again or belong<br />

in the waste because they have a<br />

crack.<br />

Today, AI can take over these relatively<br />

simple tasks and the new ISPs<br />

also have a neural network on board<br />

that runs an AI programme for image<br />

analysis. In this way, the engineers<br />

can let them make their own<br />

decisions without the need for cloud<br />

support or data flow gymnastics.<br />

Most IoT devices are battery powered but<br />

designers want to know how power consumption<br />

will fare over time. Finnish startup Qoitech<br />

has launched the Otii Arc, an inexpensive ‘little<br />

helper’ that makes it possible to precisely<br />

track current, voltage and power consumption<br />

before a device is deployed.<br />

All batteries react the same way to load – the<br />

voltage output plummets. Unlike a flashlight,<br />

an IoT sensor does not load the battery evenly.<br />

Sometimes the sensor is ‘asleep’ and consumes<br />

no energy, sometimes it sends data and<br />

consumption skyrockets for a short time. Decisive<br />

for the load profile is the software, which<br />

may or may not be cleverly written, and the<br />

environment, especially the temperature. The<br />

Otii Arc measuring device connects directly<br />

to the sensor and a laptop. It acts as a power<br />

Fraunhofer<br />

How to Bee a Sensor<br />

What does a bee need to survive? Dramatically<br />

declining populations spurred the German<br />

government to have special sensors developed.<br />

In response, researchers at Fraunhofer<br />

source ©: Micro-Sensys GmbH<br />

source and determines the load profile over<br />

the operating time until the dreaded ‘brownout’<br />

as the battery empties.<br />

Qoitech’s device allows small development<br />

offices to carry out their own measurements<br />

and tests at a high technical level. The target<br />

groups also include software developers because<br />

the more cleverly the software manages<br />

the energy reserves, the longer the sensor<br />

battery will last. Programmers can now conveniently<br />

and quickly determine the success of<br />

their efforts without having to rely on lab tests<br />

from engineering firms.<br />

Determining battery runtimes is not the easiest<br />

of tasks. Within a few months of the launch,<br />

Qoitech received a number of requests and<br />

suggestions from users, which it rapidly incorporated<br />

in a software update.<br />

IZM created ultralight wireless sensors that can<br />

be attached to a bee's back, turning the insect<br />

into a flying IoT sensor. The RFID chip transmits<br />

important flight data as well as temperature<br />

and brightness to a base station. The system,<br />

which weighs only ten milligrams, is powered<br />

by a specially developed ultra-light battery<br />

which receives its energy from a microscopic<br />

solar module.<br />

In the medium term, the Sens4Bee project,<br />

based at Fraunhofer’s Helmholtz Centre for<br />

Environmental Research (UFZ) is to become a<br />

tool for all interested beekeepers. The aim is to<br />

clarify the relationship between bee mortality<br />

and the application of pesticides.<br />

89


<strong>Smart</strong> Solutions <strong>Smart</strong> Companies<br />

<strong>Smart</strong><br />

Companies<br />

Robotics Research<br />

Automated Rapid Transit<br />

A growing list of IoT innovations<br />

have been developed and<br />

deployed by companies which<br />

are using IoT to solve real-world<br />

problems in transport. Robotics<br />

Research’s AutoDrive advanced<br />

driver assistant system (ADAS)<br />

is one of these potentially revolutionary<br />

approaches to IoT. It is<br />

‘platform agnostic’ – meaning<br />

that it can be used to retrofit<br />

vehicles of all sizes, from small,<br />

portable robots to large trucks<br />

and buses. The system provides<br />

vehicles with autonomous driving<br />

functionality on surfaces<br />

ranging from urban-improved<br />

roads to off-road terrain, while<br />

also collecting and analysing<br />

data to enhance the driving experience.<br />

Robotic Research has deployed<br />

Society of Automotive Engineers<br />

(SAE) Level-Four automation<br />

where self-driving is supported<br />

only in limited spatial<br />

areas (geofenced) or under special<br />

circumstances. Outside of<br />

these situations, the vehicle will<br />

safely abort the trip by slowing<br />

down and parking the vehicle<br />

if the driver does not retake<br />

control. The AutoDrive technology<br />

is currently operating in 30<br />

states in the US and on four continents.<br />

Recently, the company has<br />

helped the Connecticut Department<br />

of Transportation to make<br />

source ©: New Flyer<br />

Electric Commute<br />

Flyer Xcelsior Charge<br />

heavy-duty transit buses<br />

are operating on the<br />

CTfastrak corridor, a<br />

dedicated nine-mile<br />

(14.5 km) stretch for exclusive<br />

use by CTtransit<br />

buses.<br />

advancements in automated<br />

public transit thanks to a new<br />

programme funded by the US<br />

Department of Transportation.<br />

Through the department’s Integrated<br />

Mobility Innovation (IMI)<br />

initiative, Robotic Research’s<br />

proprietary AutoDrive system<br />

is enabling the automation of<br />

heavy-duty transit buses for<br />

passenger service deployment.<br />

This will be a first for mass<br />

transportation systems in North<br />

America.<br />

Three automated New Flyer<br />

Xcelsior Charge heavy-duty<br />

transit buses are operating on<br />

the CTfastrak corridor, a dedicated<br />

nine-mile (14.5 km) stretch<br />

for exclusive use by CTtransit<br />

buses. The 40-foot, electric buses<br />

will offer a zero-emission operation<br />

running between New<br />

Britain and downtown Hartford,<br />

the capital of Connecticut.<br />

As the first automated Bus Rapid<br />

Transit line put into public service<br />

in North America, the CTtransit<br />

initiative also marks the<br />

first application of automated<br />

precision docking to optimise<br />

platform gaps. This, and other<br />

automated technology to improve<br />

access, ensures boarding<br />

is compliant with the Americans<br />

with Disabilities Act (1990)<br />

which prohibits discrimination<br />

based on disability, while increasing<br />

accessibility for all passengers.<br />

90


source ©: Space&Matter, Isabel Nabuurs Fotografie<br />

Space&Matter<br />

Launching A Floating<br />

Neighbourhood<br />

Climate change may force some<br />

city dwellers to take to the water.<br />

At least, that is the thinking at architects<br />

Space&Matter, founded<br />

in 2009 by Sascha Glasl, Tjeerd<br />

Haccou and Marthijn Pool. United<br />

by the desire to improve the world<br />

for their children and all future<br />

generations, their journey began<br />

with Water voor Wonen (Water for<br />

Living), a floating neighbourhood<br />

in the low-lying Dutch polder region.<br />

"Since urban areas struggle with<br />

high density, we should make better<br />

use of the space on the water,”<br />

says Haccou. Co-founder Glasl<br />

adds, “We want to set the example<br />

and show how living on water can<br />

be a great and better alternative<br />

for people and our planet."<br />

Their signature project, which<br />

began almost a decade ago but<br />

was only completed in the summer<br />

of 2021, is called Schoonschip<br />

– literally ‘clean ship’ in Dutch.<br />

Space&Matter says it was originally<br />

a “circular neighbourhood<br />

which was initiated and developed<br />

by a group of enthusiasts with a<br />

shared dream: to build a sustainable,<br />

close-knit community on the<br />

water”. The group approached the<br />

architecture firm to help design<br />

the urban plan, plotting the boardwalks<br />

and smart jetty that unite<br />

the inspired community.<br />

The project houses more than 100<br />

people in 46 sustainable homes<br />

across 30 water plots. The area<br />

was designed to be mainly selfsufficient,<br />

with a minimal impact<br />

on nature while adapting to the<br />

rising water.<br />

Schoonschip also uses clean<br />

energy sources, using solar<br />

Sascha Glasl<br />

is passionate about strategic<br />

design, innovative<br />

concepts and democratic<br />

development processes<br />

Tjeerd Haccou<br />

likes using online and offline<br />

tools to bring together and<br />

empower communities<br />

Marthijn Pool<br />

is excited about researchbased<br />

projects that explore<br />

new urban concepts<br />

panels and heat pumps to provide<br />

heating, and the architects<br />

plan to convert wastewater<br />

from toilets and showers into<br />

energy. All buildings also have<br />

a green roof – part vegetation<br />

and geared to rainwater collection.<br />

C40 Cities Climate Leadership<br />

Group, a collaboration between<br />

the mayors of 97 cities worldwide,<br />

agree that climate change<br />

may force many to choose to<br />

live on the water. It estimates<br />

that some 800 million people<br />

and 570 cities could be at risk<br />

by 2050 if sea levels rise by half<br />

a metre, as forecasted by some<br />

experts. C40 Cities – which represents<br />

a twelfth of the global<br />

population and a quarter of its<br />

economy – believes that the<br />

floating neighbourhood in Amsterdam,<br />

Netherlands, shows<br />

one way to cope.<br />

“Living on the water offers a<br />

great solution for places where<br />

climate change and a rise in sea<br />

levels are a looming hazard,”<br />

says Glasl. “It not only protects<br />

people against nature, it also<br />

protects nature itself.”<br />

91


<strong>Smart</strong> Lifestyle One More Thing<br />

And now:<br />

One More Thing<br />

For more than a year, the team at <strong>Smart</strong> <strong>Industry</strong>, the IoT Business<br />

Magazine, has been hosting a monthly series of podcasts<br />

called We Talk IoT. These consist of interviews with experts in the<br />

various areas of IoT who have something<br />

really important to say,<br />

n By Tim Cole<br />

92


The podcast covers a wide<br />

range of topics ranging from<br />

IoT infrastructure to autonomous<br />

vehicles, artificial intelligence,<br />

predictive analysis and<br />

cybersecurity. It is sponsored by<br />

Microsoft Azure and features on<br />

Spotify, Apple Podcasts and Sound-<br />

Cloud to reach an average audience<br />

of 5,000 to 6,000 listeners per<br />

month. We encourage our interview<br />

guests to link to the podcast from<br />

their own websites and social media<br />

platforms to boost overall listenership.<br />

If you would like to hear it, you<br />

can find it through our homepage at<br />

www.smart-industry.net/podcast.<br />

Every issue of We Talk IoT concludes<br />

with a short editorial item of interest<br />

which we call One More Thing. As of<br />

now, the editors will get to choose<br />

their favourite installments to share<br />

here at the end of our print edition.<br />

Foresolution<br />

Where’s the Loo? IoT<br />

Flushes It Out<br />

One of the most challenging jobs for<br />

IoT technologies is real-time tracking<br />

of goods and assets at remote locations,<br />

even when they lack a power<br />

source. Portable toilets are a good<br />

example. They’re usually tucked<br />

away well out of sight (and smell)<br />

and sometimes the only way to find<br />

them is to send out a search party.<br />

Foresolutions, a UK technology<br />

company, thinks it’s found a better<br />

way to locate and check the status<br />

of such hard-to-find assets as porta<br />

Mobile Expandable<br />

Wellbeing Unit<br />

Compacting to a 4ft<br />

(1.2 m) cube, the<br />

MEWU fits onto a<br />

standard rail trolley or<br />

trailer anywhere on<br />

track for deployment<br />

at the point of work.<br />

The Daily<br />

Travel Puzzle<br />

At Heathrow, as in<br />

any major airport,<br />

hundreds of companies<br />

work together<br />

to make travel<br />

safe and smooth.<br />

Increasinly, they<br />

rely on IoT to coordinate<br />

thousands of<br />

routine tasks, from<br />

toilete to air traffic<br />

control.<br />

potties, construction tools and airtraffic<br />

equipment, just to name a<br />

few. The company is providing battery-powered<br />

IoT devices along with<br />

its own software for managing nonpowered<br />

items in outdoor working<br />

environments.<br />

These often include seats of ease, euphemistically<br />

called Mobile Expandable<br />

Wellbeing Units, or MEWUs<br />

(pronounced ‘mews’). These are typically<br />

bright orange, interconnecting<br />

boxes placed at railway or building<br />

construction sites. They contain<br />

removable wastewater tanks and<br />

compartments for additional<br />

source ©: Selectequip source ©: Twitter / Heathrow Airport Limited<br />

93


<strong>Smart</strong> Lifestyle One More Thing<br />

source ©: Digital Matter<br />

Live Long and<br />

Prosper!<br />

Ultra-rugged longlife<br />

battery-powered<br />

GPS devices like this<br />

one from Digicore<br />

offer up to seven<br />

years of asset tracking,<br />

theft recovery,<br />

and more.<br />

IoT data<br />

keeps units<br />

sanitised<br />

and wellmaintained.<br />

Tom Ross<br />

Foresolutions<br />

safety equipment such as defibrillators<br />

and first-aid gear. The units cost<br />

lots of money and are mostly left to<br />

fend for themselves out somewhere<br />

in the boondocks.<br />

Thanks to battery-powered sensors<br />

and wireless connectivity, Foresolutions<br />

helps railroads and construction<br />

companies keep track of their<br />

units, tell whether they are being<br />

used and when to call in maintenance.<br />

In addition, the company<br />

has deployed several thousand IoT<br />

devices at Heathrow Airport to keep<br />

track of various non-motorised assets<br />

– tools, steps, tugs and other<br />

equipment – in order to help management<br />

understand their utilisation<br />

and to locate equipment when<br />

needed.<br />

Throughout the past year, Foresolutions<br />

has been partnering with Australia’s<br />

Digital Matter, which makes<br />

battery-powered sensors that leverage<br />

wireless networks – including<br />

LTE, GSM, WiFi and Bluetooth – to<br />

forward data to the cloud, no matter<br />

where the sensor is deployed.<br />

On the mobile toilets, the company<br />

is using Digital Matter's Oyster 2 sensor<br />

devices, powered by three AA<br />

batteries, to update companies with<br />

the information they need to manage<br />

the units.<br />

Traditionally, this type of data cannot<br />

be accessed without a human<br />

visiting the station. Foresolutions'<br />

system can detect not only the GPS<br />

location but also such conditions as<br />

the opening and closing of doors,<br />

vibration, temperature and humidity<br />

changes, as well as water, ice<br />

and other outdoor conditions. Any<br />

changes in location or sensor readings,<br />

such as tilting or moving, are<br />

forwarded to the headquarters so<br />

those in charge of the stations can<br />

tell if they are being moved. After all,<br />

these units cost a lot of money and<br />

theft is not unknown.<br />

IoT data also helps to ensure that the<br />

units are sanitised and well-maintained,<br />

says Tom Ross, Foresolutions'<br />

managing director. He has plans to<br />

expand his solutions beyond mobile<br />

loos, as they’re called in the UK, to<br />

include such markets as farms, factories,<br />

hospitals and shopping centres<br />

or even amusement parks.<br />

source ©: Foresolutions<br />

source ©: Foresolutions<br />

IoT Everywhere<br />

IoT solutions in facility management can<br />

fullfil multipile roles at once, for instance<br />

building & structure monitoring, temperature,<br />

air quality, presence, occupancy,<br />

energy, noise, door opening, weather and<br />

environmental conditions, people tracking,<br />

safe distancing, as well as security & access<br />

control and CCTV.<br />

94


source ©: Marine Science Institute, UC Santa Barbara, Salesforce.com, San Diego State University<br />

SharkEye<br />

AI Drones Track and<br />

Protect Great White Sharks<br />

Academics from the University of<br />

California and San Diego State have<br />

teamed up with AI researchers from<br />

Salesforce to create software that<br />

can spot sharks swimming around<br />

popular beach sites.<br />

SharkEye, as the system is called,<br />

uses drones to spot sharks from<br />

above. The unmanned flying vehicles<br />

follow pre-programmed paths<br />

at a height of around 120 feet (36.5<br />

metres) to cover large areas of the<br />

ocean without disturbing marine<br />

life. The goal of SharkEye is eventually<br />

to produce automated ‘shark reports’<br />

for beachgoers to help them<br />

assess levels of risk.<br />

The researchers hope this application<br />

of AI can help keep beaches<br />

safer, encourage a more informed<br />

public and help people learn how<br />

to share the waves with wildlife. Perhaps,<br />

most importantly, the system<br />

could help protect the gradually improving<br />

populations of great white<br />

sharks, top predators that are a<br />

healthy part of the California ocean<br />

ecosystem, says Doug McCauley, director<br />

of the Benioff Ocean Initiative<br />

and a professor at the University of<br />

California Santa Barbara.<br />

Salesforce AI is using its proprietary<br />

Einstein Vision algorithm – ordinarily<br />

used for visual search, brand<br />

detection and product identification<br />

– to process drone video and<br />

recognise the unique attributes<br />

of sharks, thereby identifying<br />

them without the need for physical<br />

tagging. This information will<br />

then be shared with local officials<br />

and beachside communities, so,<br />

without ever touching the water,<br />

SharkEye can make sure it’s safe for<br />

the rest of us to hop in!<br />

Shark Alarm!<br />

The dashboard created<br />

for the SharkEye project<br />

at Santa Barbara's Parado<br />

Beach is meant to openly<br />

share data insights on<br />

sharks collected from dronebased<br />

arial surveys as well<br />

as acoustic detections. Both<br />

are shown on a current-day<br />

and a seven-day rolling<br />

average.The latter provide<br />

a clearer picture of trends<br />

in abundance compared<br />

to expected variation in<br />

daily peaks and dips in shark<br />

activity. Absence of shark<br />

sightings or acoustic signals<br />

are not an indicator that<br />

no sharks are present - in<br />

California's costal waters,<br />

they almost always are.<br />

The goal here<br />

is to reduce<br />

the number<br />

of traffic<br />

accidents.<br />

Ivan Ndip<br />

Fraunhofer Institute<br />

for Reliability<br />

and Microintegration<br />

(IZM) in Berlin<br />

Fraunhofer<br />

Many Still Wait for 5G –<br />

but 6G is Just<br />

Around the Corner<br />

Most smartphone owners are still<br />

waiting for 5G to appear but the telco<br />

industry is already gearing up for the<br />

next step. The starting pistol for this<br />

next generation of mobile communications,<br />

6G, has already been fired.<br />

"With 6G, we have the ambitious<br />

goal of achieving data rates of terabits<br />

per second and a latency of<br />

about 100 microseconds – that’s 50<br />

times the data rate and one-tenth<br />

the latency of 5G," says Ivan Ndip,<br />

an expert on antennas and radio frequency<br />

systems at the Fraunhofer<br />

Institute for Reliability and Microintegration<br />

(IZM) in Berlin.<br />

Ndip uses autonomous driving to<br />

explain the difference. The goal here,<br />

he says, is to reduce the number of<br />

accidents. 5G has a maximum data<br />

rate of about 20 gigabits per second<br />

– nowhere near enough to communicate<br />

a car’s position to other road<br />

users in real time, much less to measure<br />

distances and scan through 360<br />

degrees at the same time.<br />

The self-driving car needs to be<br />

able to look far into the distance<br />

while also focusing on close-up<br />

things. For this, autonomous vehicles<br />

require sensors that combine<br />

both radar and cameras, and need<br />

to be able to collect enormous<br />

amounts of data and share them<br />

simultaneously. According to Ndip,<br />

Fraunhofer IZM is currently developing<br />

such sensors.<br />

source ©: Fraunhofer Institute for Reliability and Microintegration IZM<br />

95


<strong>Smart</strong> Lifestyle One More Thing<br />

source ©: Khachi<br />

The car must also react instantly to<br />

unforeseen circumstances, so, in addition<br />

to very high data rates, the<br />

sensors must exhibit extremely low<br />

latency. Ndip says, 5G just doesn’t<br />

cut it. He adds that 5G is still missing<br />

a couple of critical components<br />

as well as the network intelligence<br />

necessary to handle true hands-off<br />

autonomous driving.<br />

“That's why we need 6G," the scientist<br />

maintains. Although 6G will not<br />

be operational until at least 2030,<br />

Ndip believes that governments<br />

and telcos need to start investing in<br />

the new technology now.<br />

Hardware still needs to be developed<br />

for mobile communications<br />

above 100 GHz but, for most manufacturers,<br />

this is terra incognita as<br />

they have never worked with frequencies<br />

like these before. Typically,<br />

researchers and developers need a<br />

ten-year head start for this kind of<br />

mammoth project, Ndip says. Setting<br />

the necessary specifications<br />

and standards alone will take at<br />

least five years, he believes.<br />

Fraunhofer recently opened its 6G<br />

Innovation Campus in Cottbus – the<br />

so-called iCampus – where it plans<br />

to do research into new networking<br />

and sensor technologies, together<br />

with the local university and two separate<br />

Leibnitz Institutes. The future of<br />

mobile communications, it seems,<br />

just can’t happen fast enough.<br />

<strong>Smart</strong> Dessous<br />

Myant's new Skiin brand<br />

textiles monitor their<br />

owner's vital functions<br />

and sleeping habits<br />

and can even wake up<br />

sleepy drivers before<br />

they doze off at the<br />

wheel.<br />

Myant<br />

A New ‘Brief’<br />

in Health Monitoring<br />

Underwear is getting a lot smarter<br />

these days. Myant, an innovator in<br />

wearables, has developed a smart<br />

pair of briefs that could potentially<br />

transform healthcare.<br />

Biometric sensors woven into the<br />

fabric of the underwear can measure<br />

things like sleep quality, activity,<br />

stress levels, temperature and<br />

heart condition, to provide some of<br />

the most reliable and effective ways<br />

to detect and prevent health issues,<br />

the company claims.<br />

The Skiin brand fabric sends data<br />

to a corresponding app and onwards<br />

to the cloud platform which<br />

analyses the data to provide guidance<br />

on lifestyle changes and the<br />

information can, with permission,<br />

be shared with healthcare providers.<br />

Underwear is a good choice for<br />

a smart garment because it makes<br />

consistent, close contact with the<br />

body – a must-have for continuous<br />

skin sensors.<br />

Myant’s underwear innovation fits<br />

into the larger trend of e-textiles<br />

and smart clothing, powered by<br />

artificial intelligence and tiny semiconductor<br />

technology. Scientists<br />

are attempting to replace clunky<br />

ECGs and health monitoring devices,<br />

like watches and chest straps,<br />

with comfortable smart garments.<br />

Healthcare providers and developers<br />

believe advances like these will<br />

increase compliance and lead to<br />

better health outcomes.<br />

<strong>Smart</strong> garments will probably be<br />

able to do much more for us. Sensors<br />

can now be embedded directly<br />

into textiles – similar to weaving additional<br />

yarn into an existing piece<br />

of fabric – or by applying sensors<br />

to the top of the fabric. Either way,<br />

the use cases for e-textiles go far beyond<br />

health monitoring. <strong>Smart</strong> garments<br />

can to do things like:<br />

• diagnose comfort levels of amputees<br />

by monitoring their interaction<br />

with their artificial limb.<br />

• assess patterns in athletes’ performances<br />

and deliver small electric<br />

shocks to underperforming<br />

muscles.<br />

• wake up sleepy drivers on the<br />

road before accidents occur, using<br />

built-in fatigue monitoring.<br />

• connect to smart home systems<br />

to do things like changing the<br />

thermostat when your body is<br />

cold (or hot).<br />

The latest report by research firm<br />

IDTechE predicts that smart textiles<br />

will be worth over $1.4 billion by<br />

2030. The number of potential applications<br />

and markets for e-textiles<br />

is vast, including military and space,<br />

automotive, haptic suits for virtual<br />

reality, sports and fitness, and assistive<br />

clothing.<br />

source ©: Skiin<br />

96


Kerlink<br />

Windmills Push Spread of<br />

Public IoT Services<br />

Like many others along the Netherlands<br />

North Sea coast, the Port of<br />

Moerdijk has a large wind farm. The<br />

farm was installed in 2020 and is<br />

operated by Vattenfall, a European<br />

green energy specialist. The wind<br />

farm supplies 27 megawatts of<br />

clean energy to more than 27,000<br />

households.<br />

But officials soon realised the turbine<br />

towers could serve an additional<br />

purpose by hosting an IoT<br />

network to provide key sensor data<br />

to the bustling port 120 metres below.<br />

IoT networking company Kerlink<br />

was commissioned to create the<br />

gateways for the LoRaWAN project.<br />

The Kerlink Wirnet iStation receives<br />

sensor data and information from<br />

within a radius of 25 kilometres and<br />

securely transfers it to users of the<br />

energy-efficient IoT network. This<br />

includes monitoring air quality,<br />

CO2 emissions, water levels and detecting<br />

whether bridges and gates<br />

around the port are open or closed,<br />

source ©: Kerlink<br />

which helps move traffic more efficiently<br />

while reducing emissions.<br />

In addition, the industrial-grade<br />

IoT network will be available at low<br />

cost for organisations near the port<br />

in shipping, rail and other industries<br />

as well as to municipalities,<br />

government agencies and individuals.<br />

Aurélien Seugnet, Kerlink’s business<br />

developer, is happy with the<br />

results so far. “The wind industry<br />

The wind<br />

industry could<br />

be crucial to<br />

builidng the<br />

public Internet<br />

of Things.<br />

<strong>Smart</strong> Station<br />

The Kerlink Wirnet<br />

iStation receives<br />

sensor data and<br />

information from<br />

within a radius of<br />

25 km and can<br />

monitor air quality<br />

in addition.<br />

Aurélien Seugnet<br />

Kerlink<br />

could become a crucial building<br />

block in the public Internet of<br />

Things,” he believes. “We usually<br />

use high buildings and pylons [as<br />

mounting points],” he added – so<br />

why not use turbine towers?<br />

The height of the towers means<br />

the signal is stronger and can reach<br />

further. Besides which, piggybacking<br />

on a wind generator does away<br />

with the constant need to change<br />

batteries.<br />

source ©: CCM Benchmark Group<br />

source ©: Storm<br />

97


Column Gerd Leonhard<br />

The Future<br />

Looks Great!<br />

Are you excited about the future or are<br />

you worried? Are you expecting good<br />

things or more misery? These days, it seems<br />

like all around us, the future is getting bleaker<br />

and bleaker. Netflix and Hollywood are telling us about<br />

dystopian scenarios. The news is showing more reels<br />

of climate change disasters, economic issues, clueless<br />

CEOs and politicians. And of course, in the end, the robots<br />

will take our jobs, and then they're going to harvest<br />

our bodies for energy.<br />

But despite all of that noise, I am here to tell you that the<br />

future is better than we think. I believe that human ingenuity,<br />

our science and technology can and will solve<br />

most of our long-standing problems. I also believe that<br />

human kindness and the ability to collaborate will prevail.<br />

But we're running out of time because the future is<br />

arriving faster than we think. Actually, the future is already<br />

here, we just haven't paid enough attention.<br />

Whether it’s enhancing humans, designing chimeras or<br />

robots going to war: What will happen during the next<br />

ten years will sweep away most of our notions about<br />

gradual progress and upend our views about how technological<br />

innovation usually and maybe even inadvertently<br />

furthers the common good.<br />

In my speeches, I have recently started talking about<br />

what I call “the good future” – a utopia (or better yet,<br />

a protopia) as opposed to a dystopia. As hard as it may<br />

be for all of us to agree on what a “good” future would<br />

look like, we must submit to the hard work of creating<br />

such a definition. Because, if we don’t reach some kind<br />

of consensus, there may be no future at all – at least not<br />

for us humans. One thing we know for certain is that<br />

the Good Future is not likely to come about with good<br />

Gerd Leonhard<br />

is the founder of<br />

The Futures Agency (TFA)<br />

and author<br />

of the bestseller<br />

Technology vs Humanity.<br />

He is based in Zurich<br />

Technology is<br />

morally neutral<br />

until we use it.<br />

William Gibson<br />

old-fashioned “greed capitalism”, and neither<br />

will it be ushered in by technology. Rather, it will<br />

be a question of ethics and values – and the policies<br />

we craft from them.<br />

Now is the time to think about and act on “civilising”<br />

– maybe a better word would be “rehumanising” our<br />

technology. Yes, this will mean regulating (but not<br />

strangulating) the global tech giants, because in this<br />

age of advanced exponential change, today’s amazing<br />

breakthroughs may well turn out to be major problems<br />

not too far down the road.<br />

It’s time to stop asking “what will the future bring” – it<br />

can, quite literally, bring almost anything we can imagine.<br />

Instead, we need to ask: “what kind of future do we<br />

want?<br />

It is a basic truth that technology can serve opposite<br />

purposes, good or bad. And as William Gibson famously<br />

said, it remains morally neutral until we use it.<br />

“Too much of a good thing” describes this conundrum<br />

very well: something quite useful can quickly become<br />

something deeply harmful and corrosive to society –<br />

as recently evidenced with social media, which suffers<br />

from excessive monetisation obsession and utter lack<br />

of accountability.<br />

We are at a fork in the road: The future is our choice,<br />

by action or by inaction. And time is of the essence. We<br />

have at most ten short years to debate, agree on and<br />

implement new, global (or at least territorial) frameworks<br />

and rules as far as governing exponential technologies<br />

are concerned.<br />

Call me an optimist or a utopian, but I am convinced<br />

that we can still define and shape a “good future” for all<br />

of mankind – as well as for our planet.<br />

98


We Talk IoT,<br />

the <strong>Smart</strong> <strong>Industry</strong> Podcast<br />

Welcome to We talk IoT, a regular series of podcasts<br />

from the editors of <strong>Smart</strong> <strong>Industry</strong> – the IoT<br />

Business Magazine. Our podcast keeps you up to<br />

date on the most important developments in the<br />

world of IoT, IIoT, Artificial Intelligence and Cognitive<br />

Computing. Listen to leading industry experts,<br />

business professionals and experienced journalists<br />

as they discuss some of today’s hottest tech topics<br />

and how they can help boost your bottom line.<br />

You can listen to the first episode right here on<br />

smart-industry.net. Or you can follow We talk<br />

IoT, the <strong>Smart</strong> <strong>Industry</strong> podcast on the following<br />

streaming providers to always get the latest<br />

episodes:<br />

Go to Spotify<br />

Go to Apple Music<br />

Go to Soundcloud<br />

This podcast is brought to you by Avnet Silica in<br />

cooperation with Microsoft.<br />

powered by


Let our wide portfolio help<br />

you meet your analog needs<br />

Innovative products for reliable,<br />

accurate, high-efficiency designs<br />

Operational Amplifiers<br />

• High voltage<br />

• Precision and high accuracy<br />

• Dual high bandwidth<br />

Power Operational Amplifiers<br />

• High output current<br />

• Low drop and high gain<br />

Current sense amplifiers<br />

• Uni- and bi-directional<br />

• Integrated, robust, and safe<br />

For more information visit www.st.com/opamp

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!