26.04.2022 Views

Smart Industry No.1 2022

Smart Industry No.1 2022 - The IoT Business Magazine - powered by Avnet Silica

Smart Industry No.1 2022 - The IoT Business Magazine - powered by Avnet Silica

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

smart<br />

powered by<br />

industry<br />

The IoT Business Magazine<br />

7.50 EUR No. 01.<strong>2022</strong><br />

THE FUTURE<br />

OF IOT<br />

KEEP ON<br />

TRUCKIN’<br />

Fixing the Logistics<br />

Bottleneck<br />

CURRENT<br />

TRENDS<br />

EV Charging<br />

Means Business<br />

Internet<br />

of Trees<br />

A Better Way<br />

to Fight Forest Fires<br />

The Age of the Digital Human<br />

THE MAN MACHINE


XILINX INNOVATIONS<br />

GET STARTED<br />

WITH YOUR DESIGN<br />

WINNING THE 5G RACE<br />

Wherever 5G drives innovation, from over the air, satellite<br />

to ground, and private network to 4.0 automation, cutting<br />

edge 5G applications require both increased bandwidth,<br />

and fast computing into a lower power and smaller form<br />

factor radio.<br />

The RFSoC product family’s breakthrough integration<br />

translates to lower power, a smaller footprint, and higher<br />

performances. It enables demanding 5G applications such<br />

as multi operators, 400MHz iBW, Multi Carriers, Sub 6GH<br />

and MMwave, whilst supporting ease of use and flexibility<br />

of design evolution.<br />

By enabling a ‘Radio in One chip’ design (from O-RAN interfaces<br />

to RF) with high performance and low power, the Zynq<br />

RFSOC family provides significant benefits for applications<br />

that require fast computing at a lower cost.<br />

avnet-silica.com


Editorial<br />

Creating<br />

the Future<br />

Tim Cole<br />

is editor-in-chief of<br />

<strong>Smart</strong> <strong>Industry</strong> –<br />

the IoT Business Magazine.<br />

<strong>Smart</strong> homes and factories, smart clothing<br />

(so-called “wearables”), autonomous<br />

cars, trucks and drones and other<br />

stuff from the world of science fiction<br />

have become everyday phenomena that introduced<br />

the world to IoT technology and its<br />

giant potential. The continued growth of this<br />

technology and its use has created a global IoT<br />

market of $389 billion, which is forecasted to<br />

reach $1 trillion in 2030 (according to Statista).<br />

IoT allows the physical world to be integrated<br />

into computer-based systems, which, in turn,<br />

helps to improve the efficiency of the systems<br />

and reduces human intervention. So we’ve<br />

come a log way, right?<br />

And it’s everywhere, effecting industries from<br />

transportation (shipment & tracking), retail<br />

(inventory management) hospitality (voice<br />

assistants) to healthcare (health & wellness<br />

monitoring).<br />

Let’s take a closer look at some of them.<br />

In retail, the global market for IoT is expected<br />

to reach $182.04 billion by 2028 according to a<br />

report by Grand View Research. Much of this<br />

growth will be due to advances and reduced<br />

cost for IoT hardware and sensors, etc., but improvements<br />

in customer experience through<br />

much increased customer tracking and personalization<br />

are expected to be the real drivers.<br />

Using beacons, brands or retail stores can<br />

attract passersby to visit their stores by sending<br />

IoT-enabled notifications to their smartphones.<br />

The Internet of Things connecting<br />

everything to everything also means connecting<br />

to everyone.<br />

Supply chain optimization will not only unlock<br />

the bottleneck for stuff that has stifled both retails<br />

waiting for shipments from Asia but manufacturers<br />

of cars and sophisticated electronic<br />

systems desperate for chips. IoT sensors do not<br />

just track location, but also humidity, temperature,<br />

tilt, shock, speed and driving behaviors,<br />

meaning that logistics teams can determine if<br />

their stuffs safe, on time and has been transported<br />

under the right conditions, thus avoiding<br />

loss and spoilage.<br />

In <strong>Smart</strong> Factories, or as the Europeans prefer<br />

to call it, <strong>Industry</strong> 4.0 machines, will take over<br />

mundane and repetitive tasks on the assembly<br />

line, freeing qualified workers for more<br />

demanding tasks where lack of talent is being<br />

felt around the world. Using powerful AI tools<br />

such as image recognition and analysis, manufactures<br />

will dramatically raise quality with<br />

hope of achieving the golden grail of making<br />

stuff – zero-reject production.<br />

The hospitality business rocked by lack of people<br />

willing to work for sweatshop wages will<br />

have to invest heavily in automation provided<br />

by IoT in everything from “connected rooms”<br />

where everything from temperature control to<br />

room service to lowering the blinds and turning<br />

on the TV will be guided by Alexa-style<br />

gadgets and smartphone that enhance the<br />

guest experience. And in maintenance where<br />

hotels spend a lot, IoT sensors can help to reduce<br />

this expenditure by detect problem and<br />

notify staff, for instance about faulty lighting<br />

and other fixes.<br />

The Internet of Things brings numerous opportunities<br />

for any business to transform itself.<br />

Companies like our sponsor Avnet Silica<br />

and many others will be happy to point out<br />

ways in which, you, too, can reap the benefits<br />

of IoT a myriad of practical use cases and applications.<br />

In you aren’t there yet, setting out<br />

on your journey to the connected future has<br />

never been easier. Bon voyage!<br />

3


contents Imprint<br />

CONTENTs<br />

03 Editorial<br />

04 Contents/Imprint<br />

06 <strong>Smart</strong> People<br />

24<br />

Welcome to the Metaverse<br />

Online communities have existed since at least the mid-1980s, but the metaverse could represent<br />

a whole new dimension. Imagine it as an online virtual world which incorporates augmented<br />

reality, virtual reality, 3D holographic avatars, video and other means of communication. As<br />

the metaverse expands, it will offer a hyper-real alternative world for you to coexist in.<br />

<strong>Smart</strong> Business<br />

12 The Man Machine: Building a Better Brain<br />

24 The Metaverse: No Time for Fun & Games<br />

29 Avnet Column: Gilles Beltran<br />

30 The Future of IoT<br />

34 Interview: Lou Lutostanski<br />

38 Why IoT Projects Fail<br />

42 IIoT: How to Eat an Elephant<br />

<strong>Smart</strong> Communications<br />

46 Keep on Trucking<br />

52 Taking Security to the Edge<br />

58 EV Charging: Current Trends<br />

58<br />

Current Trends<br />

The electric vehicle industry is on its way to market maturity but there are still twists in the road<br />

for stakeholders and customers. From accessibility and standardization issues to a lack of convenient<br />

and secure payment methods at charging stations, unresolved issues could still throw a<br />

spoke in the wheel of electric vehicles, leaving full adoption out of reach.<br />

<strong>Smart</strong> Lifestyle<br />

62 The <strong>Smart</strong>est City<br />

66 Internet of Trees: Fighting Forest Fires with IoT<br />

72 Taking 5G to the Max<br />

76 Interview: The World is Shrinking<br />

<strong>Smart</strong> Solutions<br />

78 Old Data for Sale<br />

82 Lidar<br />

86 Bernd Schöne: Liquid Software<br />

88 <strong>Smart</strong> Sensors: <strong>Smart</strong> Eyes for IoT<br />

90 <strong>Smart</strong> Companies<br />

92 One More Thing<br />

62<br />

The <strong>Smart</strong>est City<br />

Poblenau, formerly a run-down suburb of Barcelona, has reinvented itself as a neighbourhood<br />

buzzing with innovative startups, research centres and international businesses.<br />

Today, it is regularly touted as a template for urban, economic and social renewal, as well as<br />

a hotbed of IT innovation.<br />

98 Gerd Leonhard: The Future Looks Great!<br />

4


12<br />

The Man Machine<br />

The idea of linking the human brain to machines and<br />

to each other is intriguing and far from new. But now<br />

the dream of countless Sci-Fi readers may be coming<br />

true at last. Will we soon be able to control our smart<br />

machines simply through thought? Maybe it’s time to<br />

rethink our relationship with technology.<br />

IMPrint<br />

Publisher<br />

Avnet Silica (Avnet EMG GmbH), Gruberstrasse 60d,<br />

85586 Poing, Germany<br />

Production and Project Management<br />

RSP Management GmbH, Hohenbrunner Weg 41B,<br />

82024 Taufkirchen, rspitz@rsp-publishing.de<br />

Square Publishing GmbH,<br />

Bretonischer Ring 10, 85630 Grasbrunn<br />

Project manager Richard Spitz<br />

Editor-in-chief Tim Cole<br />

Text editor Eric Doyle<br />

Art director Sara D’Auria, www.inframedesign.de,<br />

Harald Sayffaerth, www.01graphics.de<br />

Contributors Göran Appelquist, Gilles Beltran,<br />

Rainer Claaßen, Marc McCoy, Sebastian Ganschow,<br />

Alan Earls, Gordon Feller, John Koon, Greg Langley,<br />

Tom Leddo, Gerd Leonhard, Michael Moorfield,<br />

Stian Overdahl, Bernd Schöne<br />

Pictures Shutterstock, Fotolia<br />

Production manager Stephan Quinkertz<br />

Printing Westermann<br />

Managing director Richard Spitz, Stephan Quinkertz<br />

© <strong>2022</strong> RSP Management GmbH and<br />

Square Publishing GmbH<br />

INTRODUCING THE MICROSOFT AZURE<br />

SPHERE ENABLED LORA GATEWAY<br />

One of the most secure and easy to manage<br />

gateways, featuring Azure Sphere<br />

• Securely monitors, tracks and manages data in<br />

almost every environment, from buildings to factories,<br />

smart cities, hospitals, agriculture and retail<br />

• Supports cellular, Wi-Fi and Ethernet connectivity<br />

• Remotely upgrade your gateways in the field, with<br />

daily authentication of hardware and software,<br />

and a failsafe over the air update mechanism<br />

• Guaranteed maintenance over the lifetime of<br />

the product<br />

• Pre-integrated security will ensure that your<br />

LoRaWAN gateway is secure and safe of the risk<br />

from cyber-attacks<br />

avnet-silica.com<br />

REQUEST<br />

DEMO


<strong>Smart</strong> People Behind the scenes<br />

Behind the Scenes<br />

<strong>Smart</strong> people<br />

All over the world, brilliant individuals are hard at work creating the technologies and<br />

solutions that will one day make the Internet of Things come alive. We visited a few<br />

of them and listened to their fascinating stories.<br />

Stockholm University<br />

Artificial Intelligence<br />

for the Planet<br />

Swedish resilience researcher<br />

Victor Galaz believes that artificial<br />

intelligence should follow the<br />

dictates of sustainability in the<br />

context of the environment and<br />

climate change. “Like many other<br />

technologies, artificial intelligence<br />

offers a mixture of opportunities<br />

and risks with regard to climate<br />

change,” he says.<br />

Crunching the<br />

Climate Numbers<br />

While AI offers more<br />

postive than negative<br />

impacts on the climate,<br />

more work still<br />

needs to be done to<br />

extract correlations<br />

from the mountains<br />

of data available.<br />

As associate professor in political<br />

science and deputy director of<br />

the Stockholm Resilience Centre<br />

at Stockholm University, Galaz recently<br />

gave a much-discussed lecture<br />

on Planetary Responsible AI at<br />

the Complexity Science Hub Vienna<br />

(CSH), where he focused on the<br />

ethical perspective of AI which he<br />

maintains must always be included<br />

in the design and use of AI systems<br />

– whether to design them according<br />

to principles of inclusion and diversity,<br />

or to reflect on the dilemmas of<br />

self-driving cars which one day may<br />

have to decide on the life and death<br />

of road-using humans.<br />

That AI offers numerous opportunities<br />

to halt or even reverse climate<br />

change is obvious: relevant patterns,<br />

changes or correlations can<br />

be extracted automatically from the<br />

growing mountains of data resulting<br />

from the monitoring of our environment.<br />

Galaz emphasises that the predictive<br />

power of artificial intelligence offers<br />

a major advantage. He believes<br />

A Positive impacts of Al: 79 % (71 %) B Negative impacts of Al: 35 % (23 %)<br />

source ©: Springer Nature Limited<br />

17<br />

12<br />

13<br />

9<br />

15<br />

8<br />

1<br />

100%<br />

100%<br />

14<br />

(100%) 75%<br />

(88%) (69%) 3<br />

90%<br />

69%<br />

(90%)<br />

(69%)<br />

80%<br />

100% 4<br />

(70%)<br />

(93%)<br />

26%<br />

56%<br />

(15%)<br />

(44%)<br />

82%<br />

100%<br />

(59%)<br />

(100%)<br />

90%<br />

100%<br />

(75%)<br />

(100%)<br />

10 100%<br />

100%<br />

(91%) 92% 58% (90%)<br />

7<br />

(77%) (52%)<br />

Enviroment: 93% (85%)<br />

Economy: 70% (55%)<br />

16<br />

2<br />

11<br />

6<br />

5<br />

Society: 82% (77%)<br />

17<br />

12<br />

13<br />

9<br />

15<br />

8<br />

1<br />

86%<br />

33% (43%) 25%<br />

(8%)<br />

3<br />

14<br />

30%<br />

(13%) 8%<br />

(13%)<br />

(8%)<br />

20%<br />

70% 4<br />

(20%)<br />

(60%)<br />

11%<br />

33%<br />

(5%)<br />

(31%)<br />

27%<br />

63%<br />

(16%)<br />

(28%)<br />

70%<br />

40%<br />

(55%)<br />

(40%)<br />

10 50%<br />

20%<br />

(34%) 33% 25% (10%)<br />

7<br />

(25%) (15%)<br />

Enviroment: 30% (12%)<br />

Economy: 33% (23%)<br />

16<br />

2<br />

11<br />

6<br />

5<br />

Society: 38% (25%)<br />

1 No Poverty<br />

2 Zero Hunger<br />

3 Good Health and Well-Being<br />

4 Quality Education<br />

5 Gender Equality<br />

6 Clean Water and Sanitation<br />

7 Affordable and Clean Energy<br />

8 Decent Work and Economic Growth<br />

9 <strong>Industry</strong>, Innovation, and Infrastructure<br />

10 Reduced Inequalities<br />

11 Sustainable Cities and Communities<br />

12 Responsible Consumption and Production<br />

13 Climate Action<br />

14 Life Below Water<br />

15 Life on Land<br />

16 Peace, Justice and Strong Institutions<br />

17 Partnerships<br />

6


that, with improved data availability,<br />

predictive modeling of climate data<br />

will make it possible to estimate developments<br />

ever more accurately<br />

and locally. AI already plays a role in<br />

the optimisation of existing systems<br />

– for example, in the more efficient<br />

use of renewable energies.<br />

High benefits also require the responsible<br />

use of the systems and<br />

Galaz's central question is: “How do<br />

we ensure that AI does not intensify<br />

environmental degradation, misinformation<br />

and social inequality?”<br />

Artificial intelligence is already being<br />

used in many variations in the<br />

field of smart farming worldwide,<br />

for example, using satellite data to<br />

optimise irrigation, pesticide use<br />

and harvesting times. To Galaz, it is<br />

unclear what ecological effects such<br />

digital agriculture, forestry and water<br />

management will have and this<br />

AI offers a mix<br />

of opportunities<br />

and risks.<br />

Victor Galaz<br />

Associate professor in<br />

political science and deputy<br />

director of the Stockholm Resilience<br />

Centre at Stockholm<br />

University<br />

raises a social question. Galaz asks:<br />

"Will the advantages resulting from<br />

automation be evenly distributed or,<br />

for example, will it have a negative<br />

impact on small farmers in African or<br />

Asian countries?”<br />

source ©: Goethe-Institut<br />

AN ENGINEER’S<br />

GUIDE TO 5G –<br />

AVNET SILICA’S NEW<br />

RESOURCE FOR<br />

DESIGNERS<br />

There has never been a better<br />

time to accelerate your 5G design<br />

journey. From infrastructure<br />

to endpoint, 5G will reach into<br />

every aspect of our business and<br />

personal lives. And there is no<br />

better place to fuel that journey<br />

than Avnet Silica’s 5G solutions<br />

page.<br />

DOWNLOAD<br />

EBOOK<br />

avnet-silica.com


<strong>Smart</strong> People Behind the scenes<br />

source ©: LinkedIn Corporation<br />

source ©: Davey Bickford Enaex source ©: Aspermont Media Ltd<br />

Davey Bickford Enaex<br />

Having a Blast and<br />

Still Staying Safe<br />

The most dangerous moment in<br />

mining is when someone lights<br />

the fuse and everybody starts<br />

running. Aymeric Denuelle, a<br />

researcher and group product<br />

marketing manager at mining<br />

How to Achieve a<br />

Better Blast<br />

IoT enhanced<br />

detonators provide<br />

a higher level of accuracy<br />

and reliability,<br />

improving blast performance<br />

while offering<br />

a user friendly<br />

human machine<br />

interface allowing<br />

fast programming.<br />

Time is money<br />

in the mining<br />

industry.<br />

Aymeric Denuelle<br />

Researcher and group<br />

product marketing manager<br />

at mining services company<br />

Davey Bickford Enaex<br />

services company Davey Bickford<br />

Enaex, wants to defuse the situation<br />

with its DaveyTronic Edge<br />

remote control electronic detonator.<br />

The system uses a common<br />

IoT radio frequency protocol to<br />

communicate with up to thousands<br />

of detonators before triggering<br />

each explosive device.<br />

Electronic detonators have been<br />

around since the 90s but, Denuelle<br />

says, they had an Achilles heel<br />

because the complex fixed-wire<br />

networks connecting the detonators<br />

to the blasting machines<br />

were prone to electrical leakage.<br />

Early wireless detonators were<br />

unidirectional – in other words,<br />

signals could be sent to a detonator,<br />

but no response could be<br />

received. DaveyTronic Edge not<br />

only does away with the need<br />

for surface wiring but also controls<br />

multiple electronic detonators<br />

from a single, safe location,<br />

thereby making the blasting<br />

process less risky and more efficient.<br />

Until now, mining workers were<br />

forced to manually check conditions<br />

before pressing the button<br />

– a process known as ‘priming<br />

the blast’. This is costly and<br />

time consuming, as well as risky<br />

in the event of human error,<br />

but the main worry was finding<br />

detonators that failed to go off,<br />

which meant searching for hours<br />

through huge piles of debris.<br />

The new system has been successfully<br />

tested in a large mine in<br />

Chile, where it proved capable of<br />

operating safely over a distance<br />

of several kilometres. As Denuelle<br />

says, “Our goal is to always<br />

provide safer solutions so that<br />

our customers can trigger larger<br />

blasts from a remote firing point.<br />

Time is money in this industry and<br />

mining companies need to spend<br />

more time collecting the ore than<br />

organising the blast."<br />

8


MORE EXPERTISE<br />

LESS COMPLEXITY<br />

Bipolar<br />

transistors<br />

Diodes Analog &<br />

MOSFETs GaN FETs<br />

Logic ICs<br />

ESD protection, TVS, filtering<br />

and signal conditioning<br />

It’s never been easier to complete your design, with essential components and expert support from<br />

Nexperia. Search & specify all your discrete and MOSFET components, analog and Logic ICs, directly online.<br />

You’ll quickly find what you need from our portfolio of 15,000+ devices, industry-leading small packages,<br />

meeting the highest industry standards.<br />

For easy access to the essential components, get more with Nexperia.<br />

nexperia.com


<strong>Smart</strong> People Behind the scenes<br />

Omni:us<br />

Taking a Flyer<br />

on Insurance AI<br />

"I like to take risks. That's how I was<br />

brought up", says Sofie Quidenus-<br />

Wahlforss, founder and CEO of<br />

Omni:us, based in Berlin. The serial<br />

entrepreneur founded her first<br />

company in Vienna while still attending<br />

high school. Now, with<br />

Omni:us, her fourth company,<br />

she is using artificial intelligence<br />

to disrupt the insurance industry.<br />

Following the company’s launch<br />

Quidenus-Wahlforss made the<br />

Forbes list of Europe's Top 50 Women<br />

in Tech.<br />

"When I was a little kid, I used to<br />

climb to the top of the tallest trees,"<br />

she recalls, adding that it was always<br />

important to her parents that<br />

she gained as much experience as<br />

possible. "When I fell from the tree,<br />

that was also an experience and it<br />

showed that I was brave."<br />

Omni:us uses artificial intelligence<br />

to digitally capture documents,<br />

including handwritten ones, to<br />

automatically evaluate them and<br />

understand what they are about.<br />

As a kid, I used<br />

to climb to the<br />

top of the tallest<br />

trees.<br />

Sofie<br />

Quidenus-Wahlforss<br />

Founder and CEO<br />

of Omni:us, based in Berlin<br />

Omni:us Classifies<br />

Documents<br />

into predefined<br />

categories based<br />

on visual and<br />

textual information<br />

and retrieves data<br />

using end2end information<br />

extraction<br />

techniques.<br />

The system learns as it goes and<br />

its analytical skills get increasingly<br />

better. Omni:us is focusing on the<br />

insurance industry. "That's where<br />

we see the greatest potential because<br />

everyone deals with insurances,"<br />

Quidenus-Wahlforss maintains.<br />

The startup earns money by<br />

selling licenses for its software.<br />

As an entrepreneur, she has learned<br />

to deal with setbacks. "I can only<br />

do this if I believe in it," she says.<br />

Quidenus-Wahlforss is firmly convinced<br />

that artificial intelligence is<br />

source ©: omni:us / Qidenus Group GmbH<br />

capable of taking the paperwork<br />

away from an insurance company's<br />

clerks so that they have more time<br />

for their customers’ needs. "It's not<br />

about replacing the employee but<br />

enabling them to focus on what<br />

they can do; namely, empathic<br />

behaviour," she explains. "No one<br />

wants a machine to end up making<br />

decisions."<br />

International investors have apparently<br />

been won over by this<br />

idea, investing a total of around<br />

€20 million in Omni:us. Many large<br />

insurance companies are already<br />

working with Omni:us, currently<br />

one of the largest German insurers<br />

Wüstenrot is running a proof-ofconcept<br />

test project.<br />

Omni:us is part of the Qidenus<br />

Group, which may look like a misspelling.<br />

In fact, Quidenus-Wahlforss<br />

had the “u” removed deliberately<br />

– something her parents<br />

and her grandmother, in particular,<br />

remain irritated about. "I kind of<br />

thought it was cooler without the<br />

‘u’," Sofie explains. "Qi is the Chinese<br />

word for energy and if you flip<br />

the letters around it's IQ. Both just<br />

fit well."<br />

source ©: omni:us / Qidenus Group GmbH<br />

10


nRF9160<br />

Low power cellular SiP with integrated<br />

LTE-M/NB-IoT modem and GPS<br />

Start your development today with the most<br />

compact, complete and energy-efficient<br />

cellular IoT solution on the market<br />

AVAILABLE NOW<br />

nordicsemi.com/nRF9160


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

Augmented Humanity<br />

THE<br />

MAN MACHINE<br />

Psychokinesis, or mind over matter, is a popular dream<br />

of sci-fi and horror story writers. In the digital world, dreams often come<br />

true and there are signs that soon we may be able to complete tasks<br />

without moving off our sofas. Remote control is changing<br />

to cerebral control – if you think it, you can do it.<br />

n By Alan R. Earls<br />

The idea of linking humans<br />

with the machines we have<br />

created and to each other is<br />

intriguing and far from new.<br />

Today, many people carry a multitude<br />

of electronic signatures and<br />

interfaces. The smartphone is the<br />

most obvious and most capable,<br />

but credit cards also carry chips<br />

with personal information and, with<br />

the pandemic ongoing, the idea of<br />

chipping vaccinated people is not<br />

out of the realm of possibility – and<br />

let’s not forget our biometric signatures.<br />

Despite their usefulness, all<br />

of these require manual manipulation.<br />

Maybe it’s time to rethink the<br />

processes by just thinking about the<br />

process.<br />

Science fiction has ridden the concept<br />

of controlling things with the<br />

power of the mind for years, notably<br />

Firefox, a Clint Eastwood thriller involving<br />

a thought-controlled fighter<br />

jet. The reality of this has been<br />

getting closer of late.<br />

Facebook shared ideas about<br />

thought-to-text capabilities in 2017,<br />

shortly after entrepreneur Elon<br />

Musk announced his plans to build<br />

Neuralink, a firm promising to `wire’<br />

brains in the future. Startups and<br />

research projects are now emerging<br />

across the globe and the key<br />

to much of this future is the `brain<br />

computer interface’ (BCI).<br />

Alexandre Gonfalonieri, an AI consultant<br />

based in Switzerland and<br />

head of innovation at DNA<br />

12


13


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

source ©: Ars Electronica Linz GmbH & Co KG<br />

To Think it is to<br />

Do it<br />

Wacker Neuson<br />

challenged visitors<br />

to Ars Electronica in<br />

Linz to operate its<br />

heavy construction<br />

equipment entirely<br />

by eye movement<br />

and thought control.<br />

Your BCI could<br />

detect that your<br />

attention level is<br />

too low or adapt<br />

the lighting<br />

based on how<br />

stressed you are.<br />

Alexandre Gonfalonieri<br />

DNA Global Analytics<br />

nual expo in Linz, Austria, that celebrates<br />

advances in digitalisation,<br />

Wacker Neuson, a British manufacturer<br />

of heavy construction equipment,<br />

challenged visitors to steer a<br />

15-ton backhoe excavator entirely<br />

by eye movement and brain power.<br />

The company envisages applications<br />

for this new technology in controlling<br />

heavy machinery in tight or<br />

hazardous environments where human<br />

operators would be in danger.<br />

Release the Beast<br />

A lot comes down to definitions,<br />

says Evan Coopersmith, executive<br />

VP of data science at AE Studio, a<br />

source ©: Medium<br />

Global Analytics, recently wrote in<br />

the Harvard Business Review, “The<br />

development of BCI technology<br />

was initially focused on helping paralysed<br />

people control assistive devices<br />

using their thoughts, but new<br />

use cases are being identified all the<br />

time. For example, BCIs can now be<br />

used as a neuro-feedback training<br />

tool to improve cognitive performance.<br />

I expect to see a growing<br />

number of professionals leveraging<br />

BCI tools to improve their performance<br />

at work. For example, your<br />

BCI could detect that your attention<br />

level is too low, compared with the<br />

importance of a given meeting or<br />

task, and trigger an alert. It could<br />

also adapt the lighting of your office<br />

based on how stressed you are or<br />

prevent you from using your company<br />

car if drowsiness is detected.”<br />

Imagine, Gonfalonieri says, if your<br />

manager could know whether you<br />

actually paid attention in your last<br />

Zoom meeting. Imagine if you could<br />

prepare your next presentation using<br />

only your thoughts. Scenarios<br />

like this might soon become a reality<br />

thanks to developments in the field.<br />

BCIs may even find their way into<br />

such mundane tasks as steering an<br />

excavator. At Ars Electronica, an ansoftware<br />

development and data<br />

science venture studio that conducts<br />

projects for clients and also<br />

funds its own BCI research. “Right<br />

now, we think of BCI in terms of<br />

something internal to a person<br />

manifesting as external action,”<br />

he says. Is a cochlear implant BCI?<br />

Yes, says Coopersmith, though he<br />

admits that others might disagree<br />

with that assessment. A BCI could<br />

also be a device that notifies the<br />

brain of an oncoming seizure. “I<br />

would say anything that is a neurological<br />

interface that connects the<br />

brain to the outside world, in either<br />

direction, is BCI and I think those<br />

boundaries will increasingly blur,”<br />

he explains.<br />

The work AE Studio is pursuing<br />

is leading edge but without any<br />

literal cutting edge involved. Coopersmith<br />

says implanting devices<br />

in someone’s skull is not the name<br />

of the game. Rather, he sees an<br />

opportunity to make better use of<br />

what can be learned from brain activity<br />

to get to a much more powerful<br />

kind of interface than is available<br />

today.<br />

“Our expertise is in software development<br />

and machine learning,<br />

and in understanding data,”<br />

14


Invasive IoT<br />

The Internet of Bodies<br />

IoB Examples<br />

source ©: RAND Corporation<br />

Cochlear<br />

implant<br />

Electronic<br />

tattoo<br />

Self-lacing<br />

shoes<br />

Bluetoothconnected<br />

diaper<br />

Wearable baby<br />

monitor<br />

Depression headset<br />

Augmented reality<br />

contact lens<br />

Wearable UV monitor<br />

Pacemaker<br />

Microchip implant<br />

<strong>Smart</strong>phone with<br />

health apps<br />

Prosthetic<br />

Temperature-sensing pacifier<br />

Antidrowning monitor<br />

Sleep-tracking onesie<br />

Brain interfaces may be a future goal<br />

but, here and now, WiFi devices are<br />

increasingly becoming integral to<br />

the delivery of quality healthcare.<br />

Common devices such as sleep<br />

trackers and heart monitors are a<br />

reality but researchers at The Rand<br />

Corporation, a think-tank, want to<br />

take the link between humans and<br />

machines a step further – literally.<br />

Swallow and Collect<br />

They imagine an era of the Internet<br />

of Bodies: a range of devices that<br />

can be implanted, swallowed or<br />

worn in order to collect and transmit<br />

data about our physical states<br />

over the internet. The result will be a<br />

huge amount of health-related data<br />

that could improve human wellbeing<br />

and prove crucial in fighting the<br />

Covid-19 pandemic.<br />

VivaLNK, a startup based in Silicon<br />

Valley, for instance, has developed<br />

smart thermometers marketed under<br />

the brand name Fever Scout.<br />

Unlike traditional thermometers,<br />

which usually involve long tubes,<br />

Intraocular lens<br />

with camera<br />

Internet-connected<br />

glasses<br />

Tooth-mounted<br />

sensor<br />

Electronic pill<br />

Clothing with<br />

temperature monitoring<br />

Fertility measurement<br />

device<br />

Internet-connected<br />

scale<br />

Internet-connected<br />

toilet<br />

VivaLNK has created peel-and-stick<br />

thermopatches that connect via a<br />

smartphone app and have already<br />

received Food and Drug Administration<br />

(FDA) clearance in the US.<br />

The company believes its product<br />

is especially suitable for monitoring<br />

child patients.<br />

For health professionals, the Internet<br />

of Bodies opens the gate to a<br />

new era of effective monitoring and<br />

treatment. In 2017, the US Federal<br />

Drug Administration approved the<br />

first use of digital pills in the United<br />

States. Digital pills contain tiny, ingestible<br />

sensors as well as medicine.<br />

Once swallowed, the sensor is activated<br />

in the patient’s stomach and<br />

transmits data to a smartphone or<br />

other devices.<br />

Meditation headset<br />

Bluetooth-connected<br />

hearing aid<br />

<strong>Smart</strong> watch/<br />

fitness tracker<br />

Temperature bracelet<br />

Artificial pancreas<br />

Electronic health<br />

records (EHRs)<br />

Sleep-sensing<br />

mattress<br />

Not Just a Patch-over<br />

VivaLnk, a Santa Clara-based<br />

connected health startup, has<br />

received FDA clearance for its<br />

first device, a peel-and-stick<br />

patch thermometer for children<br />

called Fever Scout.<br />

IoT Gets Physical<br />

From AR contact lenses to artificial<br />

pancreas and Bluetooth<br />

connected diapers: No part of<br />

the human body will remain<br />

untouches by IoB technology,<br />

says RAND.<br />

Virtual Rehab<br />

In 2018, Kaiser Permanente, a healthcare<br />

provider in California, started a<br />

virtual rehab programme for patients<br />

recovering from heart attacks.<br />

The patients shared their data with<br />

their care providers through a smartwatch,<br />

allowing for better monitoring<br />

and a closer, more continuous<br />

relationship between patient and<br />

doctor. Thanks to this innovation,<br />

the completion rate of the rehab<br />

programme rose from less than 50<br />

percent to 87 percent, accompanied<br />

by a fall in the re-admission rate and<br />

programme cost.<br />

Scientists at The Rand Corporation<br />

are studying the rapid growth of<br />

this technology, as well as the broad<br />

privacy and policy issues these developments<br />

raise. In particular, they<br />

are trying to assess the benefits and<br />

risks, the regulatory picture, and<br />

how best to balance risks and rewards<br />

going forward.<br />

source ©: Wareable Ltd<br />

15


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

Silent Speech<br />

Close, but not Close<br />

Enough (Yet)<br />

source ©: Facebook<br />

Giving AR and VR<br />

a Hand<br />

Sean Keller, Meta's<br />

head of research,<br />

is inventing soft,<br />

lightweight haptic<br />

gloves that can bring<br />

full hand presence<br />

into AR and VR.<br />

Housed in its top-secret Skunkworks<br />

tucked away in Building 8 on<br />

Meta’s campus in Menlo Park, Facebook<br />

Reality Labs (FRL) worked on a<br />

project to build a headset or headband<br />

to allow people to send text<br />

messages by thinking – tapping<br />

them out at 100 words per minute.<br />

Though last year Facebook decided<br />

16<br />

Touchie Feelie<br />

To deliver a realistic<br />

sense of touch, a haptic<br />

glove needs hundreds of<br />

actuators (tiny motors)<br />

all over the hand, moving<br />

in concert in a way that<br />

makes the wearer feel<br />

like they’re touching a<br />

virtual object.<br />

Scientists from the<br />

University of San<br />

Francisco<br />

working with Facebook<br />

have developed a wearable<br />

prototype that uses<br />

near-infrared light to measure<br />

blood oxygenation<br />

in the brain and indirectly<br />

measure brain activity in a<br />

safe, non-invasive way.<br />

source ©: Facebook<br />

to put this ‘silent speech’ project on<br />

the backburner for a while, Regina<br />

Dugan, who was then head of the<br />

Building 8 hardware division, remains<br />

a believer. “It sounds impossible<br />

but it’s closer than you realise,”<br />

she told Technology Review.<br />

It now seems it was not quite close<br />

source ©: Facebook<br />

enough. In a blog post last April,<br />

FRL research director Sean Keller<br />

said the team was happy to say that<br />

“for the first time, someone with<br />

severe speech loss has been able to<br />

type out what they wanted to say<br />

almost instantly, simply by attempting<br />

to speak”. However, he added<br />

that Facebook decided to transfer<br />

its results to the broader neuroscience<br />

community, effectively releasing<br />

it into the wild where it will<br />

continue its existence as an opensource<br />

project.<br />

“While we still believe in the longterm<br />

potential of head-mounted<br />

optical BCI technologies, we’ve<br />

decided to focus our immediate efforts<br />

on a different neural interface<br />

approach that has a nearer-term<br />

path to market: wrist-based devices<br />

powered by electromyography,”<br />

he explained. Electromyography<br />

(EMG) is a technique for analysing<br />

and recording the electrical activity<br />

produced by skeletal muscles.<br />

EMG can pick up and decode the<br />

signals for hand and finger movements<br />

at the wrist and translate<br />

them into digital commands for a<br />

device. In the near term, these signals<br />

will let people communicate<br />

with their devices with a degree of<br />

control that’s highly reliable, subtle,<br />

personalisable and adaptable to<br />

many situations. As this area of research<br />

evolves, EMG-based neural<br />

interfaces have the potential to dramatically<br />

expand the bandwidth<br />

with which we can communicate<br />

with our devices, opening up the<br />

possibility of things like high-speed<br />

typing.


source ©: UPMC, Pitt Health Science<br />

he says. No two brains are identical<br />

and they can produce a broad<br />

range of electrical responses. The<br />

challenge, he believes, is understanding<br />

how to interpret those<br />

responses and fit that knowledge<br />

into other evidence and, thereby,<br />

enhance our means of interacting.<br />

Coopersmith’s other aspiration is<br />

to see BCI developed by neutral<br />

parties rather than big, for-profit<br />

enterprises that may be tempted<br />

to use what they learn to supercharge<br />

their marketing. “The risk is<br />

both for some upstart looking to<br />

become the next Facebook/Meta,<br />

as well as Meta itself attempting to<br />

gain even more intimate access to<br />

our thought patterns,” he says. “We<br />

see this [approach to BCI] as aligning<br />

with the goals of a Web3 or Web<br />

3.0 that is more decentralised than<br />

what we have today.”<br />

For now, BCI is still mostly useful<br />

for people who have some degree<br />

of diminished agency, for example<br />

those dealing with paralysis, but<br />

here, too, targets are shifting. “We<br />

don’t know how we will define<br />

agency in 20 to 50 years; we went<br />

from a 12-second flight on a beach<br />

[the Wright brothers, 1903) to landing<br />

on the moon [1969], events<br />

separated by just 66 years,” Coopersmith<br />

notes. “It is hubristic to<br />

predict what BCI will do.” Nonetheless,<br />

it seems likely that human beings<br />

will increasingly interact with<br />

the world and each other through<br />

the mediation of technology.<br />

Pittsburgh's<br />

RNEL<br />

lab is investigating<br />

the feasibility<br />

of using<br />

intracortical<br />

microelectrode<br />

arrays implanted<br />

in motor cortex<br />

for providing<br />

high degree of<br />

freedom control<br />

of a robotic arm.<br />

The pandemic<br />

accelerated<br />

our plans for<br />

in-home testing<br />

but this has<br />

been a goal for<br />

a long time.<br />

Jennifer L. Collinger<br />

University of Pittsburgh<br />

Rehab Neural Engineering<br />

Labs (RNEL)<br />

The direction things are heading is<br />

obvious. In May of this year, a team<br />

of neural engineers at the University<br />

of Pittsburgh’s Rehab Neural<br />

Engineering Labs (RNEL) published<br />

a proof-of-principle for a bidirectional<br />

BCI – a type of BCI that enables<br />

not just data reading but also<br />

provides feedback through data<br />

writing abilities.<br />

Taking Control<br />

In other words, it enables patients<br />

with paralysis to control a rosource<br />

©: UPMC, Pitt Health Science<br />

source ©: University of Pittsburgh, Rehab Neural Engineering Labs<br />

17


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

botic arm using their thoughts and<br />

enables them to feel how hard the<br />

arm is clutching an object. Study<br />

participants were able to take control,<br />

without assistance from the researchers,<br />

to perform difficult tasks<br />

from home.<br />

Jennifer Collinger, the senior author<br />

on this report, believes this proves<br />

that BCI studies no longer need to<br />

be restricted to an on-site lab. “The<br />

pandemic accelerated our plans for<br />

in-home testing but this has been a<br />

goal for a long time,” she explains.<br />

“We need to get the technology<br />

into real-world environments. We<br />

just want study participants to be<br />

able to do the things they want to<br />

do with a BCI.”<br />

It’s All in Your Head<br />

BCI is in fact already an industry<br />

segment of significant size. A recent<br />

study, Brain Computer Interface<br />

source ©: Next Reality, WonderHowTo<br />

The new Reality<br />

Qualcomm's latest<br />

AR headset supports<br />

seven cameras,<br />

including two internal<br />

cameras for eye<br />

tracking and four external<br />

cameras which<br />

give the wearer the<br />

capability of spatial<br />

mapping.<br />

Market Size, Share & Trends Analysis<br />

Report by Grand View Research, an<br />

Indian consultancy, says the global<br />

brain-computer interface market<br />

size was valued at $1.2 billion in<br />

2019 and is anticipated to grow<br />

at an annual rate of 15.5 percent<br />

through 2027.<br />

According to this report, braincomputer<br />

interface technology is<br />

increasingly used in mobile and<br />

virtual gaming industries by integrating<br />

BCI within virtual reality<br />

(VR) headsets. Virtual gaming has<br />

opened a plethora of new opportunities<br />

for mind-controlled headsets<br />

and gadgets, which is further<br />

driving the adoption of brain-controlled<br />

interface technology. Manufacturers<br />

are increasingly focusing<br />

Elon Musk in his Own Words<br />

“A FitBit in Your Skull”<br />

"Think of Neuralink like a FitBit in<br />

your skull. Or an Apple Watch. So,<br />

we take out part of the skull, we replace<br />

that with the chip and the inductive<br />

charger and the Bluetooth<br />

antenna, and it's really quite, almost<br />

literally, like a FitBit in your skull."<br />

From an interview with Kara Swisher<br />

of the New York Times<br />

source ©: Wikipedia / Heisenberg<br />

“I want to be clear, the early applications<br />

will really just be for people<br />

who have a serious brain injury, like,<br />

where it's, like, the value of the implant<br />

is just enormous.”<br />

From Cnet<br />

“Neuralink will seek to solve a number<br />

of neurological diseases. In<br />

the next few years, we'll hopefully<br />

18


on the development of BCI-enabled<br />

video games. Grand View believes<br />

innovations such as these, are likely<br />

to drive the market for brain-controlled<br />

computer interface technology<br />

over the next few years.<br />

International Data Corporation<br />

(IDC) is taking a wider view of the<br />

market, one that includes technologies<br />

such as augmented and virtual<br />

reality (AR/VR), biometrics, exoskeletons,<br />

affective computing, ingestibles,<br />

injectables, implantables,<br />

wearables, and smart devices, as<br />

well as brain-computer interfaces.<br />

The research firm predicts that the<br />

Apple's Private Eyes<br />

The much-rumored Apple<br />

Glasses won't be on the<br />

market until 2023. But<br />

details have leaked out. A<br />

new Apple patent mentions<br />

“privacy eyewear" that aim<br />

to stop people snooping on<br />

your iPhone's display.<br />

source ©: Martin Hajek / iDrop News<br />

European segment of this augmented<br />

humanity (AH) market will reach<br />

over $50 billion by the start of <strong>2022</strong><br />

and more than $100 billion by 2025.<br />

Augmented humanity removes<br />

accessibility barriers that limit humans<br />

from performing their daily<br />

tasks, according to IDC. AH aims to<br />

empower people by developing<br />

data-driven, tech-based, innovative<br />

solutions to enable them to<br />

perform at levels they could not<br />

achieve before.<br />

IDC's The Future of Augmented Humanity<br />

in Europe: 2020–2025 Forecast<br />

estimates that investments in<br />

AH technologies will surge as both<br />

people and corporations invest<br />

in tech to improve their quality of<br />

life and achieve enhanced ways of<br />

working.<br />

Consumer needs change fast but<br />

streamlining and automating domestic<br />

and routine tasks rebe<br />

able to help someone who is a<br />

paraplegic walk again, or someone<br />

whose arms are paralyzed use a<br />

computer again. We hope to have<br />

our first human trials in the next six<br />

months or so.”<br />

From TechWeek Italia<br />

“I think you would, in principle, you<br />

would be able to communicate very<br />

quickly and with far more precision<br />

language, I’m not sure what would<br />

happen to language but in a situation<br />

like this though, it’d be kind of<br />

like the matrix. You want to speak<br />

a different language, no problem.<br />

just download the program.”<br />

From Designboom<br />

“The technology being developed<br />

by Neuralink will allow us to integrate<br />

with computers to access and<br />

process information just as well as<br />

our AI counterparts. Essentially, our<br />

brains will have our very own AI in<br />

a cloud that our brains can synthesize<br />

with as needed. We already<br />

source ©: Neuralink<br />

interface with our computers on a<br />

regular basis, so the jump from an<br />

external device to an internal one<br />

would be a natural progression.“<br />

From Teslarati<br />

“With the direct neural interface,<br />

we can improve the bandwidth<br />

between your cortex and your digital<br />

tertiary layer by many orders of<br />

Doing by Thinking<br />

Thanks to its latest<br />

brain implant, Neuralink<br />

has enabled<br />

a monkey to play<br />

video games through<br />

thought control.<br />

magnitude. I'd say probably at<br />

least 1,000 or maybe 10,000 or<br />

more. And we could also spend<br />

a lot more time thinking about<br />

interesting things, as opposed to<br />

taking complex thought structures,<br />

compressing them down<br />

into words which will also gain<br />

a very low bitrate and then having<br />

someone else receive those<br />

words, decompress them and<br />

then send words back at you.”<br />

From Clubhouse<br />

“The output of the human brain.<br />

This is excruciatingly slow, compared<br />

to, for example, the high<br />

bandwidth of the visual interface<br />

with the brain – the eyes<br />

of people. In other words: data<br />

comes in quickly, but to talk or<br />

type? That process is really slow.<br />

His idea is to capture thoughts<br />

and convert them into text or<br />

movement. Then the humanity<br />

would communicate a lot more<br />

efficiently.“<br />

From superhumantalks<br />

19


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

VR<br />

Allows the user<br />

to see and hear what<br />

the avatar sees<br />

Gloves<br />

with electrical contacts<br />

at the base of the f<br />

ingers and electrodes<br />

between fingers<br />

Face Projection<br />

Images of the face are<br />

important for the<br />

colleagues experience<br />

Surface EMG<br />

Electrodes<br />

For recording heart rate<br />

and skin moisture<br />

source ©: Human Fusions Institute, Case Western Reserve University<br />

IMUs<br />

Inertial measurement<br />

units<br />

embedded in the<br />

shirt to record<br />

arm movement<br />

Electrode<br />

Mesh<br />

This mesh will<br />

cover muscles of the<br />

arm and chest<br />

Network<br />

Mimicked<br />

Movement<br />

Positional feedback<br />

from the user<br />

Touch<br />

Images of the face are<br />

important for the<br />

colleagues experience<br />

SENSA<br />

The SENSA skeleton<br />

is based on the<br />

RE2 HDMS arms<br />

mains a priority, according to the<br />

report. In fact, investments in smart<br />

devices and wearables will remain<br />

high and will drive a significant<br />

share of the overall AH market.<br />

At the same time, businesses are<br />

searching for tech-based ways to<br />

drive innovation and achieve relevant<br />

key performance indicators<br />

(KPIs), such as lowered costs, increased<br />

productivity and improved<br />

safety. Integration is key and IDC<br />

predicts that in the future we will<br />

see strong investments in integrated<br />

technologies such as Apple's AR<br />

glasses set to launch in 2023.<br />

A Human Need<br />

“For as long as I can remember, I<br />

wanted to be in medicine. I thought<br />

about going into surgery, growing<br />

up, but I love science and math,”<br />

says Dustin Tyler, director of the<br />

Human Fusions Institute at Case<br />

Western Reserve University (CWRU)<br />

in Cleveland, Ohio. His path took an<br />

evolutionary twist when he was in<br />

high school in the early 1980s and<br />

purchased an Atari 800XL, one of<br />

the first personal computers. “That<br />

explains why I didn’t get married<br />

until I was in my 30s,” he quips.<br />

His love of computers, even in their<br />

Working Together<br />

By directly connecting<br />

the human experience to<br />

the Avatar's experience,<br />

the human and the<br />

robotic system become<br />

symbiotically linked.<br />

The human experiences<br />

the world of the robot.<br />

The robot becomes the<br />

extension of the human<br />

and the human intelligence.<br />

We can learn<br />

from both<br />

Turing and<br />

Minsky.<br />

Dustin Tyler<br />

Human Fusions<br />

Institute Case<br />

Western Reserve<br />

University<br />

primitive form, and trying to understand<br />

how to get them to do what<br />

he wanted reconnected him to his<br />

biological interests and the question<br />

of how our brains control our<br />

bodies.<br />

“The brain obviously is fascinating<br />

and the duality between brain and<br />

computer has been very interesting<br />

to me,” Tyler says. In the past,<br />

Alan Turing said we created computers<br />

to serve us but then Marvin<br />

Minsky came along and said that<br />

these machines actually do things<br />

like humans. That perception has<br />

led to some people thinking that AI<br />

is replacing the brain, he observes.<br />

source ©: Bunny Island GmbH<br />

“We can learn from both Turing and<br />

Minsky,” he concludes.<br />

While happy to quote theoreticians,<br />

Tyler is very much results-oriented.<br />

A project he directed allowed a<br />

student at CWRU to touch, feel and<br />

hold a banana that was 2,300 miles<br />

away at the University of California,<br />

Los Angeles (UCLA). It was more<br />

than just a scientific stunt because<br />

it demonstrated the possibility of<br />

placing a prosthesis somewhere<br />

in the world and via ‘neural reality’<br />

someone can literally feel identical<br />

sensations remotely. Of more<br />

immediate consequence, his team<br />

provided the sensation of physical<br />

touch to a prosthesis so an amputee<br />

could safely pick up his granddaughter<br />

or effectively slice a tomato.<br />

The Human Fusions Institute team<br />

is also aiming to win some, or all,<br />

of the Avatar XPrize, a contest<br />

sponsored by Japan’s All Nippon<br />

Airways, which is focused on the<br />

development of an avatar system<br />

that will transport a human’s sense,<br />

actions and presence to a remote<br />

location in real time, leading to a<br />

more connected world.<br />

Pursuing similar goals is Raviraj<br />

Nataraj at the Stevens Institute of<br />

20


source ©: Stevens Institute of Technology<br />

Technology in Hoboken, New Jersey.<br />

His laboratory is creating instrumented<br />

wearables and virtual<br />

reality environments to leverage<br />

sensory feedback and cognitive<br />

factors for training better movement<br />

functions. Clinical solutions<br />

are being developed for people<br />

with neurotraumas, including spinal<br />

cord injury, stroke, traumatic<br />

brain injury and amputation. Restorative<br />

devices of interest include<br />

sensorimotor prostheses and powered<br />

exoskeletons.<br />

Nataraj explains that the challenge<br />

is to command and control prosthetics<br />

more naturally, through biological<br />

signals. Until now that has<br />

been accomplished through muscle<br />

movement but it could also be<br />

done with the brain. “We currently<br />

take measurements at the brain but<br />

more to see how people respond to<br />

the training we are providing,” he<br />

says. That effort is especially crucial<br />

for people dealing with severe motor<br />

disabilities, for whom signaling<br />

through muscles is problematic.<br />

“The principles have been established<br />

but now it is about how to do<br />

it better so we can have an actual<br />

impact at the clinical level,” says Nataraj.<br />

Cost is also an issue, he admits<br />

because specialised, sophisticated<br />

products typically carry a high price<br />

tag.<br />

Gaming the World<br />

Cost associated with new, experimental<br />

technology has often been<br />

addressed by finding a larger-scale<br />

market to drive prices down. While<br />

serious and critical needs in human<br />

wellness and the military are top<br />

targets for BCI, a surprising level of<br />

interest has also materialised in the<br />

‘fun’ segments such as gaming.<br />

The dream here is to create total<br />

immersion into a game world<br />

by linking the gamer’s cognitive<br />

The principles<br />

have been<br />

established<br />

but now it's<br />

about how to<br />

do it better.<br />

Raviraj Nataraj<br />

Stevens Institute<br />

of Technology<br />

A Step Ahead<br />

Researchers have<br />

created a powered,<br />

individualized orthosis<br />

that can automatically<br />

adapt the level<br />

of response, but their<br />

goal is to eventually<br />

get rid of the robot and<br />

walk normally without<br />

the exoskeleton.<br />

perceptions directly to the virtual<br />

environment and allowing direct<br />

control through thought processes.<br />

This dream, at least, is now close to<br />

fruition. Two years ago, computer<br />

scientists at the Graz Technical University<br />

in Austria showcased versions<br />

of such simple, but popular,<br />

video console games as Pong and<br />

Pacman. Users could control the<br />

games through an array of sensors<br />

attached to a close-fitting cap.<br />

Last April, the team managed to<br />

implant a device containing 1,024<br />

electrodes directly into the motorcortex<br />

of a monkey’s brain – the region<br />

of the cerebral cortex involved<br />

in the planning, control and execution<br />

of voluntary movements. The<br />

animal was taught to play Pong<br />

with a joystick and subsequently<br />

learned to control the game by<br />

brainwaves alone.<br />

Gary Yamamoto, CEO of Finch<br />

Technologies, which focuses on<br />

VR and AR technologies, asks, “Today’s<br />

human-machine interfaces<br />

are woefully behind new advances<br />

in technology. What is the purpose<br />

of all these new, incredible technologies<br />

if there aren’t intuitive and<br />

natural ways for people to interact<br />

with them?”<br />

Finch is looking at how AR and VR<br />

applications can include all current<br />

human-machine interfaces (HMIs),<br />

including BCI, computer vision,<br />

voice solutions, inertial measurement<br />

units (IMU) for finger and<br />

hand tracking, eye tracking<br />

source ©: Stevens Institute of Technology<br />

21


<strong>Smart</strong> Business Title Story: Augmented Humanity<br />

source ©: Finch Technologies Ltd<br />

Pointing the Way<br />

The FinchRing is a new kind of wearable<br />

that enables hands-free gesture control<br />

for AV and VR mixed reality.<br />

source ©: Finch Technologies Ltd<br />

and more. Finch’s fusion integrates<br />

third-party technologies with its<br />

own products to move HMI experiences<br />

to the next level and accelerate<br />

the realisation of the Metaverse.<br />

“If we don’t do enough to evolve<br />

human-machine interfaces with<br />

this technology, I fear they may<br />

never reach their full mass-market<br />

potential,” Yamamoto warns. Despite<br />

this, he maintains the company<br />

believes that “sooner than<br />

most expect” we will see a basic<br />

BCI, fused with more conventional<br />

inputs, deliver a broader and more<br />

immersive sensory VR/AR user experience.<br />

Sooner than<br />

most expect,<br />

we will see<br />

a basic BCI.<br />

Gary Yamamoto<br />

Finch Technologies<br />

Technology<br />

will help<br />

humans<br />

elevate their<br />

skills.<br />

Andrea Minonne<br />

IDC Augmented<br />

Humanity Launchpad<br />

source ©: IDC UK Blog<br />

Most significantly in the case of<br />

Musk, the ambition comes with<br />

real misgivings about the growing<br />

power of artificial intelligence and<br />

machine learning and its potential<br />

to at least sideline, if not in fact conquer,<br />

humans. His Neuralink company,<br />

which is working to develop<br />

what it calls a brain-machine interface,<br />

is about levelling that playing<br />

field and giving humans abilities<br />

that will help them compete better<br />

on a planet with billions of connected<br />

things, a growing number<br />

of which are also intelligent.<br />

If anyone is looking for another<br />

reason to pay attention, they can<br />

adopt the IDC view, articulated by<br />

Andrea Minonne, senior research<br />

analyst and co-lead of the Augmented<br />

Humanity Launchpad at<br />

the firm’s UK offices: "Augmented<br />

humanity is the advocate of cultural<br />

change across the commercial<br />

and consumer segments,” he says.<br />

"Promoting an AH-oriented culture<br />

and complementing human skills<br />

with technology will help humans<br />

elevate their skills, automate business<br />

processes or domestic chores,<br />

unlock new capabilities, bring disruption,<br />

promote workforce transformation,<br />

and enable humanised<br />

customer experiences."<br />

Could much the same be said for<br />

BCI itself?<br />

Navigating the Metaverse<br />

Human-machine interfaces<br />

(HMIs) could empower users to<br />

compete with technology in an<br />

interconnected world.<br />

What’s the Point?<br />

While Finch focuses on fun and the<br />

researchers at CWRU and at Stevens<br />

Institute are keen on restoring capabilities<br />

to those with disabilities,<br />

other visionaries, such as billionaire<br />

Musk, are aiming even higher and<br />

have suggested a future in which<br />

our thoughts and desires are also<br />

communicable and actionable<br />

through technology.<br />

22


RENESAS WINNING COMBINATIONS<br />

Combine to Design Faster<br />

The unbeatable combination of Renesas + Dialog delivers comprehensive reference<br />

design solutions from our system architects and FAEs.<br />

These compelling product combinations are starting points to accelerate<br />

designs and get to market faster.<br />

Visit renesas.com/win for all the details on 250+ solutions<br />

to jumpstart your next design today<br />

© <strong>2022</strong> Renesas Electronics America Inc. (REA). All rights reserved. All trademarks are the property of their respective owners.


<strong>Smart</strong> Business Metaverse<br />

Metaverse<br />

No Time for<br />

Fun and Games<br />

For years, the great virtual reality (VR) breakthrough has been expected<br />

but it looks as though it didn’t even happen during the pandemic – at least,<br />

not in the private sector. But the technology is becoming<br />

a great success within many industrial companies.<br />

n By Rainer Claaßen<br />

24


Whether it’s Sony PlayStation<br />

VR, Google Glass<br />

or cardboard mounts<br />

that can turn any<br />

smartphone into a virtual reality (VR)<br />

machine, none of these products has<br />

brought the promised commercial<br />

breakthrough. In fact, some products<br />

appear to have stalled completely.<br />

Though one might conclude from<br />

this that the high hopes many had<br />

in these technologies have been<br />

dashed, it isn’t necessarily so, because<br />

new technologies often reach<br />

the mainstream in unexpected ways.<br />

The pandemic has wrought a change<br />

and VR is finding new applications in<br />

business. No longer restricted to a<br />

few lighthouse projects from huge<br />

companies, the technology has become<br />

more versatile, less expensive<br />

and much easier to access and many<br />

companies have started using VR<br />

and will expand its uses in the years<br />

to come.<br />

In a virtual reality simulation, users<br />

move around in an artificial world,<br />

largely disconnected from reality,<br />

with the help of technical tools. The<br />

immersion is most convincing when<br />

VR headsets are used. They are not<br />

absolutely necessary, because a lot<br />

of content can also be played back<br />

on a smartphone or tablet. These<br />

viewers become a window into an<br />

artificial world. Virtual reality differs<br />

from augmented reality (AR) where<br />

additional information or media is<br />

blended with a real-world, camerasourced<br />

image.<br />

Artificial Worlds<br />

There are two basic ways in which VR<br />

experiences can be produced: by developing<br />

a virtual world in software<br />

from scratch or photographically.<br />

Programming an environment can<br />

be time consuming and expensive<br />

but taking photos and videos that<br />

capture an all-round view offers a<br />

quicker and easier solution. Cameras<br />

like the Ricoh Theta or the Insta 360<br />

are available for just a few hundred<br />

euros, deliver surprisingly good<br />

quality and are almost as easy to operate<br />

as conventional cameras.<br />

A typical application scenario is in in-<br />

source ©: De:central Days<br />

Playing it Serious<br />

It’s no secret that many professional soccer players<br />

are also keen users of game consoles. They are<br />

using VR technology to get better training and many<br />

premier league clubs are choosing tools from sports<br />

technology company Rezzil.<br />

Rezzil’s system allows professional players to hone<br />

different skills, especially headers. Heading a ball is<br />

a health risk, so it is often avoided in training. Being<br />

dustrial workplaces where complex<br />

processes need to be permanently<br />

in operation. Until now, they have<br />

usually been shut down, or run at<br />

reduced speed, to train new employees.<br />

The time spent on this familiarisation<br />

can be drastically reduced<br />

with the help of VR.<br />

Companies can<br />

now create VR<br />

applications very<br />

quickly without<br />

the need for<br />

external support.<br />

Sara Boss<br />

Head of Sales at VRdirect<br />

able to practice without any danger gives teams a<br />

big advantage on match day.<br />

In addition, with full-body tracking and methods to<br />

analyse cognitive characteristics, like scanning, decision<br />

making and pressure coping, the technology<br />

helps to improve their general gameplay. It can also<br />

be useful in injury rehabilitation when training on the<br />

field is not possible.<br />

Virtual Training<br />

VR technology can help<br />

professional soccer<br />

players hone their skills,<br />

for instance headers,<br />

without risk of injury.<br />

Sara Boss, head of sales at VRdirect,<br />

explains, "Without having to spend<br />

a large budget on it, companies can<br />

now create VR applications themselves<br />

very quickly and without the<br />

need for external support. This option<br />

is often used for training purposes<br />

in particular."<br />

The background for the experience<br />

is a video or photo shot from the<br />

perspective of an employee at the<br />

workspace. A trainee can use this to<br />

get an overview of the entire environment<br />

without having to actually<br />

enter the workplace.<br />

"The ability to give people an authentic<br />

impression of a workplace<br />

without much effort is already enormously<br />

helpful. This effect is further<br />

enhanced by the inclusion of additional<br />

media content," says Boss.<br />

VRDirect offers a platform through<br />

which companies can access the<br />

virtual infrastructure. Any file<br />

25<br />

source ©: Rezzil, Google LLC


<strong>Smart</strong> Business Metaverse<br />

photo ©: Amazon.com<br />

photo ©: BNP Paribas<br />

Meta What?<br />

It seems like everybody is<br />

talking about the metaverse as<br />

the next big thing that's going<br />

to revolutionise our online lives.<br />

But everyone seems to have<br />

their own idea of what the<br />

metaverse is.<br />

The term originated in the<br />

cyberpunk novel Snow Crash<br />

by Neal Stephenson in 1992. In<br />

it, everyone in the world shares<br />

an ‘imaginary place’ made<br />

available to the public over a<br />

worldwide fiber-optic network<br />

and projected through virtual<br />

reality goggles.<br />

Online communities have existed since at least the mid-1980s but the<br />

metaverse could bring a whole new dimension. Imagine it as being a<br />

virtual world which incorporates augmented reality, virtual reality, 3D<br />

holographic avatars, video and other media. As the metaverse expands,<br />

it will offer a hyper-real alternative world in which people coexist.<br />

Fans of the metaverse envision its users working, playing and staying<br />

connected with friends through everything from online concerts and<br />

conferences to virtual trips around the world.<br />

Interest in pure digital ownership – and the technology that proponents<br />

believe can ensure the security of persistent virtual experiences – has<br />

spiked dramatically, with non-fungible tokens (NFTs) and cryptocurrencies<br />

making the headlines. Virtual productivity platforms are growing,<br />

too, with Facebook and Microsoft announcing new ways to collaborate<br />

online. Nike is even preparing to sell virtual sneakers and has filed<br />

patents to this effect.<br />

In a recent interview with Time magazine, John Egan, CEO of L’Atelier<br />

BNP Paribas, said, “This metaverse<br />

concept gives us the opportunity<br />

to create any universe<br />

that we’ve ever imagined.”<br />

For now, spending any part of<br />

a workday in the metaverse still<br />

seems like a far-off dream for<br />

most of the global workforce,<br />

with many remaining unconvinced.<br />

For them, the memories<br />

John Egan<br />

CEO of L’Atelier BNP Paribas of the first virtual world, Second<br />

Life, may still be too fresh.<br />

Second Life is a real-time, immersive social space for people to interact<br />

through anonymous avatars. Launched by Linden Labs in 1999, in its<br />

heyday it boasted a currency of its own, Linden Dollars, and largely<br />

financed itself through the sale of rentals for virtual properties and the<br />

income from premium memberships. In 2013, the system had around<br />

36 million registered user accounts but a series of scandals, including<br />

the rape of virtual children, caused user numbers to plummet and<br />

Second Life is now often derisively referred to as the "avatar graveyard”.<br />

26<br />

that can be included in a PowerPoint<br />

presentation can also be integrated<br />

into the VR environment. For example,<br />

graphics or videos can be used<br />

to clearly show the necessary work<br />

steps. Artificial worlds can also be<br />

generated by importing computeraided<br />

design (CAD) plans instead<br />

of real-world images. Rather than<br />

redrawing the 3D environment, the<br />

relevant data is often available from<br />

the original manufacturers and architects.<br />

Thanks to standardised<br />

interfaces, more companies are finding<br />

it easier to go down this route.<br />

Choose Your Reality<br />

Until recently, high-performance<br />

computers connected to playback<br />

devices were needed to display vivid<br />

VR experiences. Now, several manu-<br />

Windows to the<br />

Virtual World<br />

Several manufacturers<br />

offer standalone<br />

products through<br />

which VR experiences<br />

can be played<br />

back with excellent<br />

quality.<br />

facturers offer standalone products<br />

through which VR experiences can<br />

be played back with excellent quality.<br />

Besides the Oculus headset from<br />

Facebook, HTC’s Vive and Pico’s visor<br />

are particularly worth mentioning<br />

here. All of them offer technically<br />

mature and well-equipped devices<br />

for just a few hundred euros – and<br />

there are specially tailored packages<br />

for companies.<br />

Companies are benefiting from VR in<br />

a variety of ways. Automotive giant<br />

BMW, for example, used the technology<br />

to let customers participate in a<br />

Virtual Showrooms<br />

Automakers are using VR to<br />

allow customers to participate<br />

in live events without leaving<br />

their homes or offices.<br />

source ©: Actualités télécoms et high-tech, Amazon.de, Pico Interactive<br />

source ©: BMW AG, BMW M GmbH


joint event at the BMW i Motorsport<br />

Virtual Garage Experience. Regardless<br />

of pandemic constraints, attendance<br />

through the use of Pico VR<br />

headsets deeply impressed the virtual<br />

delegates.<br />

VR has also enabled telecom company<br />

Orange Polska to train over<br />

1,000 employees. The average learning<br />

time decreased from four hours<br />

to 45 minutes and effectiveness<br />

increased. Almost 70 percent of the<br />

trainees now think that traditional<br />

teaching should be replaced by VR<br />

training in the future.<br />

Shortly before Mark Zuckerberg announced<br />

a bright future for VR and<br />

renamed his company Meta, Facebook’s<br />

consumer-market Oculus<br />

headsets also expanded into the<br />

business arena. Its Horizon Workrooms<br />

app has been designed to let<br />

people work together in the same<br />

virtual room from anywhere in the<br />

world.<br />

One particularly impressive use case<br />

comes from BSH Hausgeräte, a joint<br />

home appliance and digital services<br />

venture between Bosch, Siemens<br />

and Neff, which has integrated<br />

We can now<br />

experience the<br />

use of tools with<br />

colleagues from<br />

different factories<br />

virtually.<br />

Juan Luis Cihuelo<br />

BSH coordinator<br />

source ©: BSH Hausgeräte GmbH<br />

Zuckerberg is betting big on virtual reality<br />

To the Metaverse<br />

and Beyond n By Eric Doyle<br />

Mark Zuckerberg plans to help<br />

build the ‘metaverse’, an ambitious<br />

three-dimensional world that will<br />

merge real life with a virtual reality<br />

existence in an unlimited universe<br />

of playgrounds. He predicts that the<br />

metaverse will supplant the internet<br />

with the bold promise that “you’re<br />

going to be able to do almost anything<br />

you can imagine”.<br />

As CEO of the company, he announced<br />

last October that Facebook,<br />

the umbrella company that includes<br />

the social media giant alongside<br />

Instagram and WhatsApp, will be<br />

renamed Meta to underscore the<br />

importance of the initiative. During<br />

the presentation, he outlined some<br />

of the experiences that users will be<br />

able to enjoy: competing against holograms<br />

of Olympic athletes or going<br />

to virtual concerts with your friends.<br />

In the business world, there will be<br />

mixed-reality meetings where some<br />

participants are physically present<br />

while others beam in from the metaverse<br />

as avatars, cartoon-like images<br />

of themselves.<br />

You're going to<br />

be able to do<br />

almost everything<br />

you can<br />

imagine.<br />

Mark Zuckerberg<br />

CEO of Meta/Facebook<br />

source ©: Facebook / Mark Zuckerberg<br />

The metaverse is no more than a<br />

concept at the moment and potential<br />

partners like Meta, Microsoft,<br />

Apple and Nvidia have yet to discuss<br />

plumbing issues, such as technical<br />

standards and, further down the<br />

line, how much compute power will<br />

be required and its environmental<br />

impact. There are also moral issues<br />

to be considered in the light of the<br />

recent Facebook Papers revelations<br />

about the company’s apparent reluctance<br />

to take action against bullying<br />

and misinformation on its current<br />

platform.<br />

It may be some time before the metaverse<br />

virtually becomes a reality. In<br />

the meantime, the press is likely to<br />

be overpopulated with articles discussing<br />

its possibilities and benefits,<br />

its limitations and negative impacts.<br />

That it will happen in some form or<br />

other is beyond question because the<br />

3D virtual world is too attractive and a<br />

future reality akin to USS Enterprise’s<br />

Holodeck in Star Trek is beguiling.<br />

27


<strong>Smart</strong> Business Metaverse<br />

Interview<br />

source ©: Advantech Service-IoT GmbH<br />

Intuitive Experience<br />

An interview with June Hsieh, senior<br />

B2B sales manager at HTC Vive,<br />

about the impact of VR in business<br />

environments.<br />

VR makes<br />

training larger<br />

groups during<br />

the pandemic<br />

much easier.<br />

June Hsieh<br />

HTC Vive<br />

Do you have the impression that<br />

VR technology in companies received<br />

a boost from the pandemic?<br />

Companies like VW have been using<br />

VR in training since 2016. In an<br />

environment where production<br />

processes are constantly being optimised,<br />

it is extremely difficult to<br />

teach employees new procedures<br />

under pandemic conditions. Training<br />

larger groups is, after all, hardly<br />

possible in the company. VR applications<br />

make this much easier. In<br />

our case, the significant increase in<br />

sales of the goggles already shows<br />

that companies are using the technology<br />

intensively.<br />

Are there any areas where VR<br />

works particularly well?<br />

Many customers use VR technology<br />

for training and to familiarise<br />

new employees – but there's also a<br />

lot happening in the planning area.<br />

Service providers such as Halocline<br />

make it easier for companies that<br />

have no previous experience in this<br />

area to get started.<br />

Isn't learning to use headsets and<br />

the programming process very<br />

time-consuming both for companies<br />

and employees?<br />

Over time, the application has become<br />

quite intuitive. Of course, you<br />

need some time to get used to the<br />

VR experience but those who get<br />

into it quickly, soon get to grips<br />

with it. Producing VR content has<br />

also become much easier lately.<br />

Many newcomers are surprised at<br />

how easy integration has become.<br />

virtual reality as a commonly used<br />

tool throughout its factories. VR has<br />

allowed BSH to reduce the time and<br />

costs for developing new production<br />

lines by accelerating the engineering<br />

processes.<br />

"Finding ourselves in the same virtual<br />

room with suppliers, colleagues<br />

and the production machines, we<br />

are able to review and release new<br />

designs, " explains Juan Luis Cihuelo,<br />

BSH coordinator in the Zaragoza<br />

plant in Spain.<br />

Staying Healthy<br />

During lockdown, the technology<br />

also helped to safeguard the health<br />

of staff while keeping production<br />

lines running. "We could experience<br />

the material supply and the use of<br />

tools with colleagues from different<br />

factories virtually," he adds. This<br />

large utilisation of VR tools required<br />

less effort than previous projects.<br />

"In the past, we were focused on<br />

highly sophisticated and expensive<br />

IT tools for digital factory planning<br />

and the specialists required to use<br />

these tools, like VR Caves,” says Ralf<br />

Just Another Day<br />

at the Office<br />

VR will become part<br />

of everyday life in the<br />

business environment<br />

much sooner than<br />

in private life, some<br />

experts predict.<br />

Nagel, product owner for the <strong>Industry</strong><br />

4.0 digital factory at BSH. A Cave,<br />

which stands for a Cave Automatic<br />

Virtual Environment, is an immersive<br />

VR environment where projectors<br />

are directed at between three and<br />

six of the walls of a room-sized cube.<br />

“However, to be successful in digitalisation,”<br />

he continues, “it is necessary<br />

to focus on the people, the<br />

cultural change and the scalability<br />

of the solutions. For us, this means<br />

that every engineer worldwide can<br />

use VR technology for planning and<br />

engineering in daily work and benefit<br />

from its integration into our digital<br />

factory backbone and the global<br />

digital collaboration."<br />

There is an increasing number of<br />

indicators that VR technologies will<br />

become part of everyday life in the<br />

business environment more quickly<br />

than in private life. It makes work<br />

easier, saves money and creates new<br />

opportunities for collaboration. It<br />

also helps people across continents<br />

to work together more efficiently<br />

and more quickly.<br />

source ©: Meta<br />

28


E-Mobility<br />

think again about<br />

vehicle ownership<br />

The wholesale electrification of<br />

transportation systems will be a<br />

key element of ongoing efforts<br />

to reduce carbon emissions and<br />

tackle the climate change challenges that<br />

our society is now facing. It will also be<br />

pivotal in addressing the air pollution issues<br />

that are currently being experienced in densely<br />

populated urban areas.<br />

Electric vehicle (EV) sales have reached new<br />

heights over the course of the last 18 months, with<br />

EU data showing that they now represent approximately<br />

11% of all new car registrations. It is clear that<br />

the numbers are going to increase still further in the<br />

coming years, with the EU’s target for EVs to constitute<br />

well over half of vehicle registrations in member<br />

states by the end of this decade. Likewise, major investment<br />

in rail networks has resulted in a migration<br />

away from diesel-based trains to ones that rely on<br />

electrical propulsion - with clear environmental and<br />

public health benefits consequently being derived.<br />

The deployment of extensive charging stations is<br />

essential if continued uptake of EVs is going to be<br />

encouraged - and this will be an integral part of<br />

many of the smart city projects that are currently<br />

being planned across Europe. Much of the earlier<br />

equipment that had initially been used is now in the<br />

process of being replaced by higher voltage rapid<br />

chargers. These will offer greater convenience to<br />

vehicle drivers, as the recharge times supported are<br />

cut from several hours to less than 30 minutes, closer<br />

to the length of a fuel-pump visit. At the same time,<br />

high-power wallbox charging units are starting to<br />

be installed within the residential environment.<br />

Raising the voltage levels of EV powertrains will be<br />

another important step in driving more widespread<br />

EVs are the<br />

fastest growing<br />

subsegment in<br />

the automotive<br />

IC market.<br />

Gilles Beltran<br />

President Avnet Silica<br />

adoption of these vehicles. This will<br />

mean that efficiency figures can be<br />

boosted and their overall weight reduced.<br />

The key benefit of all this will<br />

be that far longer distances may be<br />

covered between recharges, giving the<br />

public greater confidence that buying an<br />

EV is the right decision.<br />

The EV era may also lead to established views<br />

on vehicle ownership, which have remained the<br />

same for over a century, being re-evaluated. Instead<br />

of simply buying cars, mobility-as-a-service business<br />

models might start to be explored. Connection of<br />

EVs to the electrical distribution network will also<br />

present homeowners with financial incentives to<br />

participate in grid-balancing activities.<br />

This large-scale transport electrification is bringing<br />

unprecedented demands for semiconductor components.<br />

EVs are the fastest growing subsegment<br />

in the automotive IC market, increasing by approximately<br />

68 percent during 2021 with a further 25 percent<br />

growth expected in <strong>2022</strong> * . EV powertrains and<br />

rail infrastructure will require access to advanced<br />

semiconductor technology, including the latest<br />

wide bandgap discretes. As well as state-of-the-art<br />

power devices, commercial fast charging stations<br />

will mandate next generation data connectivity and<br />

superior security solutions. Robust and responsive<br />

supply chains must therefore be in place, so as to<br />

ensure that shipment schedules can be maintained.<br />

The engineering team at Avnet Silica has a deep<br />

understanding of the dynamics involved in transport<br />

electrification and their logistical implications.<br />

This means that our operations are fully prepared to<br />

ramp up in procurement activity that is on the horizon.<br />

* Avnet TAM analysis<br />

29


<strong>Smart</strong> Business IoT & Regulation<br />

IoT & Regulation<br />

The Future of IoT<br />

The Internet of Things (IoT) is poised<br />

to disrupt and transform many<br />

industries. While IoT is still in its<br />

infancy, businesses are already<br />

experiencing improved operational<br />

efficiencies, productivity growth,<br />

cost reductions and new revenue<br />

generation opportunities. These<br />

gains are likely to increase and scale<br />

across the economy as IoT technological<br />

maturity and adoption increaes.<br />

n By Gordon Feller*<br />

Emerging technologies, such as<br />

IoT, can take ten or more years<br />

to reach market saturation<br />

from incubation. The US federal<br />

government stimulates this journey<br />

through targeted investments<br />

in research and development (R&D)<br />

and technology transfer as part of its<br />

Lab-to-Market process. In 2020, the<br />

US government invested $140 billion<br />

in a broad range of federally-funded<br />

R&D programmes, including emerging<br />

technologies. Approximately<br />

$50 billion of this total was directed<br />

towards nearly 300 government<br />

owned, government operated laboratories<br />

across the country. Some of<br />

these investments will likely yield<br />

extraordinary, long‐term, economic<br />

impacts when they are transferred<br />

to and used by industry.<br />

IoT is now ranked as strategically<br />

important by each of the major<br />

US federal agencies that focus on<br />

increasing competitiveness, economic<br />

prosperity, and national<br />

security.<br />

For IoT to realise its potential and<br />

achieve these benefits, a robust<br />

and secure technology infrastructure<br />

is required. This requires addressing<br />

two fundamental questions<br />

to ensure that resources are<br />

effectively allocated:<br />

• Where are the technology infrastructure<br />

gaps that prevent IoT<br />

technologies from being more<br />

widely adopted?<br />

• Where should the US federal<br />

government be directing resources<br />

and investments to<br />

close these gaps?<br />

30<br />

*Gordon Feller has been reporting on emerging tech trends for over 40 years. He served as Global Fellow at the Smithsonian Institution<br />

and founded the non-profit Meeting of the Minds. He’s been awarded several fellowships, including the Abe Fellowship.


NIST Steps Up<br />

The National Institute of Standards<br />

and Technology (NIST) is a nonregulatory<br />

agency within the US<br />

Department of Commerce. Its role<br />

is to promote technology innovation,<br />

competitiveness and the<br />

commercialisation of federallysponsored<br />

research across all government<br />

agencies. NIST is central<br />

to the Lab-to-Market efforts, serving<br />

as the coordinator of the President's<br />

Management Agenda Cross<br />

Agency Priority Goal 14 (Lab-to-<br />

Market) and co-chairing a National<br />

Science and Technology Council<br />

(NSTC).<br />

"Given the strategic importance of<br />

IoT, and in support of the Lab-to-<br />

Market initiative, NIST felt that it<br />

needed to better understand the<br />

source ©: National Science Foundation<br />

NIST wants to<br />

better understand<br />

the current<br />

state of IoT<br />

research efforts.<br />

Sethuraman<br />

Panchanathan<br />

Director of National Science<br />

Foundation<br />

current state of IoT research efforts,"<br />

says Sethuraman Panchanathan,<br />

Director of National Science<br />

Foundation and co-chair of NTSC's<br />

Committee on Science and Technology<br />

Enterprise. To answer the<br />

two fundamental questions, he<br />

says, NIST has funded a research<br />

grant aimed at four key goals:<br />

• To better understand the current<br />

state of IoT research efforts.<br />

• To assess the top technology infrastructure<br />

gaps.<br />

• To quantify the benefits of closing<br />

those gaps.<br />

• To identify where future federal<br />

research investments should be<br />

made, whether it be in targeted<br />

research investments, stimulating<br />

private sector investment<br />

incentives, or other methods.<br />

This new in-depth analysis is already<br />

helping NIST to address<br />

some of the pressing IoT-related<br />

challenges by becoming better<br />

informed about the necessary<br />

31


<strong>Smart</strong> Business IoT & Regulation<br />

steps, future programmes, and the<br />

smart initiatives and investments<br />

which can support long-term economic<br />

outcomes.<br />

A California-based company,<br />

Strategy of Things, was awarded<br />

the NIST grant to conduct this research<br />

study. The research team<br />

is examining IoT opportunities in<br />

ten key industries, which together<br />

represent a significant portion of<br />

the US economy:<br />

Agriculture<br />

Construction<br />

Energy/Utilities<br />

Financial Services<br />

Healthcare<br />

Manufacturing<br />

Retail<br />

Public Sector<br />

• Telecommunications<br />

Transport<br />

Benson Chan, a senior partner<br />

at Strategy of Things, serves on<br />

the team of experts, assisted by a<br />

network of partners from government<br />

and the private sector, to ensure<br />

that the research project truly<br />

assists key leaders.<br />

The government<br />

wants to work<br />

on gaps in the<br />

technology<br />

infrastructure.<br />

Benson Chan<br />

senior partner at<br />

Strategy of Things<br />

Step by Step to IoT<br />

Initial findings from NIST<br />

predict that the evolution<br />

of IoT will occur in<br />

four distinct phases,<br />

each building on the<br />

infrastructure, capabilities,<br />

solution maturity<br />

and market adoption of<br />

the previous one.<br />

Chan argues that “IoT technologies<br />

bring enormous disruptive<br />

and beneficial impacts to national<br />

security, economic prosperity,<br />

human safety and well-being.<br />

But a number of technology infrastructure<br />

barriers stand in the<br />

way”. Because of this, he concludes<br />

that “while a number of<br />

established and start-up companies<br />

are developing IoT solutions,<br />

the federal government<br />

source ©: Benson Chan / Private Photo<br />

wants to work on the technology<br />

infrastructure gaps that industry<br />

is looking at. These include those<br />

that are not yet market ready, as<br />

well as those that no one company<br />

has the interest or resources<br />

to develop.”<br />

IoT’s Development Phases<br />

While the research is ongoing and<br />

won’t be completed until early<br />

<strong>2022</strong>, initial findings predict that<br />

the evolution of IoT will occur<br />

in four distinct phases (see Figure<br />

One). Each successive stage<br />

builds on the infrastructure, capabilities,<br />

solution maturity and<br />

market adoption of the previous<br />

one.<br />

Today’s best-of-breed IoT applications<br />

are largely point solutions<br />

that address operational<br />

inefficiencies and productivity.<br />

As underlying technologies mature<br />

and as customer acceptance<br />

grows, future IoT applications are<br />

becoming increasingly more sophisticated.<br />

They are being tightly<br />

integrated with operations and<br />

The IoT Journey: Operational Efficiency<br />

Full Autonomy<br />

Sensorization<br />

Connected Devices<br />

Vendor Ecosystems<br />

Sensor / Actuator Densif ication<br />

Massively connected devices and system of systems<br />

<strong>Industry</strong> and extended ecosystems<br />

Analytics / Machine Learning<br />

Artificial Intelligence<br />

Ambient Intelligence<br />

Ubiquitous connectivity and computing<br />

New Business and Operation Models<br />

Policies and regulations<br />

Secure and Private<br />

Trusted<br />

Ethical<br />

source ©: Strategy of Things<br />

32


The IoT Journey: Operational Efficiency<br />

Full Autonomy<br />

Edge Devices and Gateways – Processing capability, power efficiency, power management<br />

Distributed architectures – edge, mobile edge, cloud; interoperable system of systems<br />

Artifical and ambient Intelligence – autonomous intelligence, distributed collaborative<br />

intelligence<br />

Trust Architectures and Models (security, privacy, distributed ledger technology)<br />

Communications and networks at scale<br />

(stability, availability, reliability, context and date aware, etc.)<br />

Data Models, Marketplaces, Ecosystems<br />

Ethical algorithms and governance<br />

Interoperability and standards<br />

source ©: Strategy of Things<br />

information technology systems,<br />

and with each other. In short,<br />

these future IoT applications will<br />

become part of a larger, automated<br />

system of systems. The<br />

emerging solutions are focused<br />

on enabling fully-automated operations<br />

across industry ecosystems<br />

and they promise to yield<br />

transformative benefits that can<br />

only be envisioned today.<br />

The drivers of IoT evolution do<br />

differ at each stage of the evolutionary<br />

process. For instance, today’s<br />

IoT applications use a small<br />

number of sensors. The data collected<br />

from these sensors is aggregated<br />

and analysed largely<br />

through machine learning. IoT<br />

vendors expand the functionality<br />

and utility of their solutions by<br />

building and operating their own<br />

ecosystems to create an end-toend<br />

system.<br />

IoT evolution is being driven by<br />

technological advancements, interoperability<br />

across industries,<br />

government policies and regulations,<br />

and scale. Ten sensors in a<br />

factory today will soon become<br />

tens or hundreds of thousands.<br />

In these upcoming systems of<br />

systems, machine learning will be<br />

replaced by ambient intelligence,<br />

where all devices can interact with<br />

each other autonomously and intelligently.<br />

With this integration,<br />

cybersecurity evolves to a broader<br />

concept of trust which encompasses<br />

not only the integrity of<br />

the data, the connections and the<br />

devices but also the decisions, the<br />

reliability and availability, and the<br />

equity of the outcomes.<br />

To facilitate the future state of IoT,<br />

the research has identified some<br />

potential areas of technological<br />

research investment (see Figure<br />

Two). These were identified based<br />

on a study of the IoT accelerators<br />

shown in Figure One. While there<br />

is some research on these topics<br />

today, it is largely done independently<br />

in a few areas. A broader<br />

and more coordinated research<br />

agenda is required to accelerate<br />

the maturity and adoption of IoT<br />

within the US.<br />

Where to Invest?<br />

To enable the future<br />

state of IoT, research<br />

from NIST has highlighted<br />

a number of<br />

potential key areas<br />

for future technology<br />

research investment.<br />

IoT is a disruptive and transformational<br />

emerging technology. For it to<br />

realise its full potential, governments<br />

must understand the substantial<br />

economic, strategic and national security<br />

implications of IoT better. The<br />

significance of IoT’s development is<br />

too important to be left to organic<br />

evolution or to chance alone. The<br />

US federal government, through<br />

its R&D investments and policy development,<br />

needs to play a critical<br />

role in accelerating the maturity and<br />

adoption of IoT. The wide-ranging<br />

study process, as convened by NIST<br />

and as implemented by Strategy of<br />

Things, is already helping to bring<br />

key stakeholders together.<br />

Next Steps<br />

The next stage of this effort is being<br />

focused on offering a portfolio<br />

of opportunities for action. These<br />

moves can not only be taken by<br />

any one of a myriad of government<br />

agencies but also by a growing<br />

network of committed technology<br />

partners: private companies, universities,<br />

foundations, associations.<br />

33


<strong>Smart</strong> Business Interview: Lou Lutostanski<br />

source ©: Avnet Silica<br />

Why should someone look to a<br />

distributor like Avnet for information<br />

about IoT?<br />

Throughout our history, Avnet has<br />

been the provider of enabling technologies<br />

for OEMs of electronic<br />

devices. Supporting the Internet<br />

of Things is a natural progression<br />

of our business, and we are positioned<br />

to support this transformation<br />

of delivering insights through<br />

connected devices. We recognise<br />

that our OEM customers who build<br />

“The Things” in “IoT” (the Internet<br />

of Things”) will face significant skill<br />

and resource challenges as market<br />

demands are requiring them to add<br />

cloud-based features and connected<br />

experiences to their traditional<br />

products. IoT implementations are<br />

complex and span many different<br />

disciplines that require a significant<br />

number of software skills that were<br />

not needed in the past. Recognising<br />

this gap, Avnet has invested<br />

significant resources in acquiring<br />

and developing IoT Software capabilities<br />

that can help our OEM<br />

customers create these connected<br />

experiences using the principles of<br />

We're trying<br />

to build<br />

security<br />

options into<br />

IoTConnect,<br />

so implementing<br />

the<br />

desired level<br />

of security is<br />

as easy as<br />

checking a<br />

box to order<br />

fries with<br />

your burger.<br />

Lou Lutostanski<br />

Vice President for IoT<br />

at Avnet<br />

IoT. We are prepared to support IoT,<br />

and over the past three years, we<br />

have built a solid practice and added<br />

over 700 IoT and Cloud software<br />

developers to an already significant<br />

number of hardware engineers.<br />

And we will continue to evolve so<br />

that we maintain our position as a<br />

significant technology enablement<br />

partner to our customers.<br />

Seems to me that every time<br />

someone does a new IoT project<br />

they reinvent the wheel. Is that really<br />

necessary?<br />

No, it is not. While there will always<br />

be some level of customisation in<br />

bespoke IoT applications, many<br />

companies continue to spend the<br />

majority of their time and money<br />

building and maintaining their<br />

own IoT platform using open<br />

source or Hyperscale Cloud IoT<br />

Services. This significantly extends<br />

their time to market and robs them<br />

of the resources that would be<br />

better spent on providing differentiated<br />

value in the way of their<br />

applications. It also creates significant<br />

overhead to maintain the IoT<br />

platform, which in the end, their<br />

customers will pay for.<br />

Other companies hire system integrators<br />

to build a custom IoT platform.<br />

Again, it delays time to market,<br />

incurs great expense, and locks<br />

them to one company (the SI) who<br />

they will be reliant on for the lifetime<br />

of the application as their IoT<br />

platform must be maintained into<br />

perpetuity.<br />

Spending time building or having<br />

someone else build an IoT platform<br />

for companies that create value<br />

through applications and IoT implementations,<br />

is a waste of time and<br />

money. And it adds zero value to<br />

their end customer.<br />

This is the number one reason why<br />

IoT is not scaling, and in turn, not<br />

reaching the forecast in connections<br />

predicted several years ago.<br />

Talking of ecosystems, you once<br />

criticised what you called 'ecosystem<br />

mass confusion'. How should<br />

customers go about selecting an<br />

ecosystem?<br />

Ask yourself, what would be the<br />

state of the mobile phone industry<br />

34


Interview<br />

Making<br />

‘Things’ Easier<br />

The world of IoT is changing fast and the number<br />

of vendors and solutions are legion. Finding the right<br />

supplier can be tricky, says Lou Lutostanski,<br />

vice president for the Internet of Things at Avnet.<br />

He was named IoT Leader of the Year at Industrial IoT<br />

World in 2019. Lutostanski talked with <strong>Smart</strong> <strong>Industry</strong><br />

editor Tim Cole about the future of IoT.<br />

n By Tim Cole<br />

potential return on their investment.<br />

And in the case of IoT, the<br />

higher the potential ROI, the richer<br />

the applications, AI algorithms, and<br />

hardware purpose built for the solution.<br />

The bottom line is, customers today<br />

should look for an ecosystem that<br />

can invest the most in research and<br />

development and yield the optimal<br />

features because they integrate<br />

into an IoT platform that is based<br />

on HyperScale Cloud IoT Services<br />

that can be used horizontally across<br />

many or all IoT solutions. In this<br />

way, the application that they buy<br />

will not require them to bear a part<br />

of the substantial additional cost<br />

of maintaining the platform. That<br />

cost will be born by the thousands<br />

and tens of thousands of customers<br />

that buy various applications built<br />

on that IoT platform. Additionally,<br />

it will prevent lock-in of one or several<br />

vendors and give them the<br />

if there were hundreds of operating<br />

systems rather than the few<br />

available today. What would be<br />

the quality and usefulness of user<br />

applications if every manufacturer<br />

wrote their own operating system?<br />

Fortunately, this industry gravitated<br />

towards just two OS providers,<br />

which has enabled a massive<br />

ecosystem supporting developers<br />

and markets for applications.<br />

In comparison, ecosystems for IoT<br />

developers and users are not at<br />

this level of maturity, and there is<br />

a lot of confusion around identifying<br />

the ecosystem that is going to<br />

provide the solid foundation for<br />

this industry.<br />

IoT ecosystems form around IoT<br />

platforms. These platforms provide<br />

the rules and structure for the<br />

various partners to integrate their<br />

products and services in a manner<br />

that is compatible with all other<br />

partners required for a successful<br />

IoT implementation.<br />

Partners who add value within any<br />

ecosystem are attracted by the<br />

popularity of a platform. The fewer<br />

platforms available, the higher the<br />

Build & Deploy<br />

IoTConnect Platform is a smart<br />

IoT platform that<br />

helps boost efficiency,<br />

manage assets and<br />

adopt innovation.<br />

source ©: Avnet<br />

BACnet<br />

IoT Portal<br />

Dashboards<br />

Rule Engine<br />

Analytics on<br />

Gateway<br />

CoAP<br />

Command Execution<br />

SMS<br />

SDK<br />

MQTTS<br />

Protocol<br />

Alerts &<br />

Notification<br />

Push Notification<br />

HTTPS<br />

Email<br />

Data<br />

Engineering<br />

Conection<br />

Bridge<br />

SAP HANA<br />

WS<br />

SAP BI<br />

Machine Learning<br />

Data Streaming<br />

Data Analysis<br />

Salesforce<br />

ERP<br />

AMQP<br />

CAN bus<br />

35


<strong>Smart</strong> Business Interview: Lou Lutostanski<br />

Getting Started<br />

maximum number of vendor choices<br />

for their IoT implementation.<br />

Tell me more about Avnet IoTConnect<br />

which seems to be an interesting<br />

approach.<br />

Avnet’s IoTConnect is an IoT platform<br />

built on Microsoft Azure microservices.<br />

Our microservices architecture<br />

enables us to adapt to<br />

the evolving needs of our users and<br />

developers, and we view Microsoft<br />

as one of two hyperscale cloud providers<br />

who can support Avnet for<br />

the long term. We believe alternative<br />

platform architectures built on<br />

open-source technologies are too<br />

complex to maintain and become<br />

stagnant shortly after their release.<br />

But building from the established<br />

Microsoft Azure ecosystem has provided<br />

a solid foundation.<br />

Based on our deep and long-term<br />

relationships with our semiconductor<br />

suppliers and OEM customers<br />

and our growing capabilities<br />

in cloud, IoT, AI, security, and application<br />

software, we believe our<br />

IoTConnect Platform can serve as<br />

an enabler to allow for simple, fast,<br />

and secure IoT implementations.<br />

And if we are successful in getting<br />

IoTConnect adoption as one of the<br />

two or three standard Horizontal<br />

IoT Platforms, then the scale that<br />

the industry has been expecting<br />

and is now demanding can become<br />

a reality.<br />

It would have been much easier<br />

for Avnet to help our customers<br />

with their IoT implementations,<br />

It's Official!<br />

The W3C has declared<br />

the WoT Architecture<br />

and the WoT<br />

Thing Description to<br />

be official recommendations<br />

for the<br />

standardisation of IoT<br />

applications.<br />

if there were already one or two<br />

established platforms out there.<br />

But there were not. And as such,<br />

the complexity and risk associated<br />

with IoT discouraged our customers<br />

from pursuing strategies that could<br />

create substantial growth in device<br />

counts that would have in turn fueled<br />

growth for our business. The<br />

lack of an established IoT platform<br />

also forced us to help customers<br />

create hardware solutions with<br />

limited use as they were bespoke<br />

to only the IoT platform they were<br />

designed for.<br />

source ©: Avnet<br />

Azure Sphere<br />

development kits<br />

provide everything<br />

you need to begin<br />

prototyping and<br />

developing Azure<br />

Sphere applications.<br />

Sounds like IoTConnect is offering<br />

a type of Plug and Play for IoT.<br />

Plug and Play is a term that I first<br />

heard about in the PC industry.<br />

It applied to PC peripherals that<br />

could plug directly into a PC without<br />

the requirement of the user<br />

being forced to run software programmes<br />

to install drivers.<br />

Plug and Play in the IoT world is<br />

exponentially more complex. The<br />

number of things, software elements,<br />

and connectivity methods<br />

source ©: W3C<br />

36


used to create IoT solutions are infinite.<br />

So creating rules for how these<br />

things interact with each other in<br />

the way of the platform, and having<br />

the software and hardware skills<br />

to assist those connections, is what<br />

makes Avnet the ideal entity to bring<br />

the physical and virtual worlds, the<br />

OT and IT worlds, together.<br />

We believe that Avnet will succeed<br />

while other companies, some much<br />

bigger than Avnet, have failed because<br />

they did not have a deep understanding<br />

of all the parts of IoT.<br />

People with device or connectivity<br />

solutions did not understand the<br />

cloud and above. And the cloud<br />

people lacked the deep embedded<br />

device experience to create a scalable<br />

means for rapidly onboarding<br />

an infinite number of “Things”.<br />

source ©: Informa PLC, Jeremy Coward<br />

You advise bringing order to IoT.<br />

What do you mean by that?<br />

It means developing software rules<br />

that allow companies with many<br />

different types of hardware and<br />

software products and services to<br />

participate in successful IoT implementations,<br />

without having to<br />

understand the complexities of all<br />

the technologies required to produce<br />

them. IoTConnect defines<br />

those software rules and provides<br />

a mechanism to manage those<br />

devices, integrate third party software,<br />

and integrate applications<br />

and AI in a manner that delivers<br />

simple, fast, and secure IoT implementations.<br />

It allows OEMs to deliver<br />

rich features and user experiences<br />

around their products and the<br />

opportunity to create new services<br />

to deliver revenue beyond just the<br />

physical hardware.<br />

Are IoT solution providers really<br />

addressing the security problem<br />

in an adequate fashion?<br />

The majority are not. Security is extremely<br />

complex. And with many<br />

companies building their own IoT<br />

platforms or paying someone to<br />

build it for them, budgets are usually<br />

blown before the complexities<br />

of security can be addressed.<br />

I would make two comments about<br />

IoT security.<br />

• People who are serious about IoT<br />

will never deploy at scale without<br />

some level of security. The financial<br />

liabilities and the potential<br />

damage to their brand are just<br />

too significant.<br />

• For those that deploy without security<br />

by design that get hacked,<br />

the only fix is to start over. (Rip &<br />

Replace).<br />

Avnet has built varying levels of<br />

securities into IoTConnect. And we<br />

are working with third party security<br />

and identity providers to integrate<br />

their IP into IoTConnect to facilitate<br />

the deployment of security<br />

after the fact. So one can preclude<br />

security through small or test deployments<br />

and implement security<br />

at a later date. Avnet’s goal through<br />

IoTConnect is making adding security<br />

to your IoT implantation as easy<br />

as adding fries to your burger order.<br />

How do you scale IoT?<br />

The industry needs to limit the<br />

number of IoT platforms to less<br />

than a handful. This will attract<br />

partners and create a vast and vibrant<br />

ecosystem. Companies need<br />

stop building, or paying someone<br />

to build their own IoT platforms<br />

and build their applications and<br />

Expert Opinion<br />

Lou Lutostanski, Vice<br />

President of IoT at<br />

Avnet, was named<br />

IIoT Leader of the<br />

Year at Industrial IoT<br />

World 2019.<br />

product experiences around one or<br />

two that have wide adoption in the<br />

industry such as the WoT Standard<br />

released by the W3C. Customers<br />

will never accept that they will have<br />

to maintain an equal number of IoT<br />

platforms to the number of applications<br />

that they deploy.<br />

How does the COVID pandemic<br />

accelerate IoT?<br />

I think there are two answers to that<br />

question. One is that most people<br />

are working from home now and<br />

we're finding they appear to be<br />

much more efficient. As such, they<br />

have much more time to think long<br />

term regarding applying IoT technology<br />

in their products or services.<br />

The other thing is that there's a<br />

whole new generation of applications<br />

that have been spawned<br />

for contact tracing, prescreening,<br />

medical monitoring, which have an<br />

urgency about them coupled with<br />

an extreme requirement for action.<br />

This has created a whole new application<br />

category, if you will, built to<br />

deal with the challenges presented<br />

by the Covid pandemic. So, I think<br />

these two factors have accelerated<br />

the deployment of IoT implementations.<br />

37


<strong>Smart</strong> Business Six Hurdles<br />

Six Hurdles<br />

Why IoT<br />

Projects Fail<br />

The number of businesses aiming to leverage IoT solutions is high but so<br />

is the failure rate. Network giant Cisco estimates that 74 percent<br />

of projects fail and the probable cause is a failure to understand<br />

the top obstacles and challenges that often derail IoT deployments.<br />

n By Bryan Witkowski<br />

38<br />

038-041 Why IoT Projects Fail-JC.indd 38 26.04.22 13:10


Increased<br />

Complexity<br />

Increased<br />

Complexity<br />

The explosion in the use of<br />

connected devices has created<br />

a rising need for organisations<br />

to harness data<br />

from them, which, in turn, is driving<br />

businesses to ramp up their<br />

IoT digitisation efforts. Market and<br />

consumer data specialist Statista<br />

reckons there are approximately<br />

21.5 billion interconnected devices<br />

in the world and many businesses<br />

– 94 percent, according to IOT<br />

Signals, a report from the Hypothesis<br />

Group and Microsoft – see<br />

this growth as an opportunity to<br />

analyse data and generate insights<br />

that reduce operational costs, enable<br />

better decision-making and<br />

drive innovation.<br />

Here are some of the most common<br />

hurdles blocking the track to<br />

successful adoption of IoT projects.<br />

Increased complexity – There<br />

can be many challenges around<br />

interoperability between networks,<br />

gateways and devices. A<br />

multi-vendor environment can<br />

include compatibility issues between<br />

different vendors’ products<br />

and systems, especially when<br />

The challenges<br />

may seem<br />

overwhelming,<br />

but there are<br />

many options<br />

available.<br />

Bryan Witkowski<br />

Head of Strategic Planning<br />

and co-founder of MachineQ<br />

source ©: MachineQ<br />

39<br />

038-041 Why IoT Projects Fail-JC.indd 39 26.04.22 13:10


<strong>Smart</strong> Business Six Hurdles<br />

Number of Internet of Things (IoT)<br />

connected devices worldwide from 2019 to 2030, by use case *<br />

30,000<br />

20,000<br />

10,000<br />

7,741<br />

<br />

<br />

<br />

<br />

8,738.8<br />

Connected Vehicles<br />

<strong>Smart</strong> Grit<br />

Consumer Internet & Media Devices<br />

Others<br />

16,436.6<br />

14,759.9<br />

13,146.3<br />

11,570.2<br />

10,065.1<br />

18,148.9<br />

19,908.4<br />

21,721.2<br />

23,570<br />

25,444.5<br />

source ©: Statista<br />

0<br />

2019 2020 * 2021 * <strong>2022</strong> * 2023 * 2024 * 2025 * 2026 * 2027 * 2028 * 2029 * 2030 *<br />

Additional Information: Worldwide; 2019 to 2020<br />

* in millions<br />

some use proprietary technology<br />

that is not based on industry standards.<br />

For example, differences in<br />

authentication and identification<br />

methods may cause access issues<br />

and the use of different protocols<br />

can limit the ability of devices and<br />

systems to ’talk to each other’ and<br />

share information. There are also<br />

challenges related to complexity<br />

of deployment, especially where<br />

there is no access to IT support and<br />

the installation is typically done by<br />

skilled workers who are not technically<br />

savvy. An example of this<br />

would be plumbers doing a water<br />

meter installation.<br />

Limitations to Scale – As IoT<br />

networks grow, some of the challenges<br />

above become even more<br />

pronounced because of additional<br />

devices and systems. As a result,<br />

What are They Doing?<br />

The single largest use<br />

case in terms of number<br />

of Internet of Things<br />

(IoT) connected devices<br />

is consumer internet<br />

and media devices,<br />

accounting for a third<br />

of all devices worldwide<br />

in 2030. The other two<br />

largest use cases are<br />

smart grid (e.g. smart<br />

meters) and connected<br />

vehicles.<br />

the solutions created in one context<br />

may not work well in another,<br />

which could delay or stop an enterprise<br />

IoT project.<br />

Talent Shortages – Similar to the<br />

current IT talent shortage, there is<br />

a lack of available IoT experts to fill<br />

needed positions. This can affect<br />

a range of industries, such as food<br />

services and hospitality, that are<br />

looking to embrace IoT. According<br />

to research from Inmarsat, 46<br />

percent of organisations stated<br />

that skills shortages are the most<br />

significant barrier to their deployments.<br />

A lack of qualified, skilled<br />

talent can affect the ability to roll<br />

out new deployments or have the<br />

proper quality controls in place to<br />

take IoT from the proof-of-concept<br />

(POC) phase to full production.<br />

Security Vulnerabilities – While<br />

IoT devices are great at doing what<br />

they are designed and built for,<br />

they typically have limited computing<br />

resources, which means<br />

they often lack built-in security<br />

features – or they are connected<br />

to the internal IT infrastructure,<br />

which poses additional risks to security.<br />

The resultant expansion of the attack<br />

surface and opportunities for<br />

cybercriminals often stems from<br />

the fact that many organisations<br />

don’t see IoT devices as a highsecurity<br />

threat, so they are not as<br />

diligent with passwords or encryption.<br />

In addition, IoT devices often<br />

don’t receive security patches as<br />

quickly as other mainstream devices,<br />

such as laptops and smartphones.<br />

All of this can lead to more<br />

IoT-related cyberattacks, as in the<br />

40<br />

038-041 Why IoT Projects Fail-JC.indd 40 26.04.22 13:10


case of a supplier of IoT cameras<br />

that discovered a software vulnerability<br />

which exposed a range of<br />

industrial devices to potential cyberattack.<br />

Limited reach – Many industries<br />

that want to use IoT solutions face<br />

the challenges of remote sites located<br />

in far-reaching geographies<br />

and areas that are hard to reach.<br />

For example, an oil rig in the middle<br />

of the ocean or a pipeline that<br />

stretches for hundreds of miles<br />

across the countryside can make<br />

it difficult to get consistent, reliable<br />

connectivity to support the<br />

transfer of data from numerous<br />

sensors out to the cloud or to endapplications.<br />

Power Consumption – Using hundreds<br />

or thousands of sensors also<br />

creates a concern that can impact<br />

cost – battery life. It’s important to<br />

explore how long a battery will last<br />

in an IoT device because the time<br />

and cost of replacement might be<br />

just as expensive as the original<br />

deployment.<br />

As a result, this can have a significant<br />

impact on the total cost of<br />

ownership (TCO) of the project<br />

– sometimes sufficient to affect<br />

overall cost-feasibility. This TCO<br />

issue can leave an organisation<br />

stuck in the POC phase, unable to<br />

move on to production.<br />

While these challenges may seem<br />

overwhelming, there are many<br />

Challenges to using IoT more<br />

Still in Progress<br />

Complexity/Technical<br />

Security<br />

Complexity/Technical<br />

Lack of Budget/Staff<br />

Complexity/Technical<br />

Lack of Budget/Staff<br />

Lack of Knowledge<br />

Security<br />

Compliance<br />

Lack of Knowledge<br />

Complexity/Technical<br />

Lack of Knowledge<br />

Leadership/Team Challenges<br />

Security<br />

Haven’t Found Right Solution<br />

options available for enterprises.<br />

Technologies such as low-power,<br />

wide-area networks (LPWANs) can<br />

provide the simplicity, scale, reach,<br />

security and power needed to take<br />

many IoT projects from concept<br />

(POC) to reality (full production<br />

deployment).<br />

Still implementing our current solutions<br />

Too complex to implement because of technology demands<br />

Security risk isn’t worth it<br />

Want to work out challenges before adding/using IoT more<br />

Don't have human resources to implement & manage<br />

Too complex to implement because of business transformation needed<br />

Don't have budget<br />

Not enough training/guidance on how to deploy<br />

Concerned about consumer privacy<br />

Too many compliance/regulatory challenges<br />

Lack technical knowledge<br />

Too long to implement<br />

Don't know enough<br />

No buy - in from senior leadership<br />

Unwilling to store data on public cloud<br />

No solution that meets our needs<br />

Where IoT Breaks Down<br />

A third of companies are still<br />

implementing their current<br />

solution; 27 percent say the<br />

technological demands are<br />

prohibitive; and another 27<br />

percent feel the security risk<br />

simply isn’t worth it.<br />

Low Power<br />

Consumption<br />

One of the key competitive<br />

advantages of<br />

LoRaWan technology<br />

is the energy efficiency<br />

of the equipment.<br />

29%<br />

27%<br />

27%<br />

26%<br />

25%<br />

24%<br />

23%<br />

22%<br />

22%<br />

21%<br />

21%<br />

20%<br />

20%<br />

19%<br />

18%<br />

17%<br />

Vendors Share the Same<br />

Environment<br />

The LoRaWAN industry standards,<br />

for example, mean that different<br />

vendors’ products can offer compatibility<br />

to allow them to easily<br />

exist in the same environment.<br />

Finally, the automated nature of<br />

these solutions allows organisations<br />

to free up employees’ time to<br />

focus on activities that positively<br />

impact sales and customer service.<br />

By having a better awareness and<br />

understanding of these key challenges,<br />

enterprises can confidently<br />

take the important first step towards<br />

solving them and making<br />

large-scale IoT deployments a reality.<br />

source ©: Hypothesis Group, Microsoft<br />

LoRaWan Differentiators & Benefits<br />

Public and<br />

Private<br />

Deployment<br />

Options<br />

Firmware<br />

Updates<br />

Over-the-Air<br />

Geolocation<br />

Bi-Directional<br />

Security<br />

10+ Year<br />

Battery Life<br />

Coverage in<br />

Rural and<br />

Non-Cellular<br />

Area<br />

Deep<br />

Penetration<br />

(Concrete,<br />

Ground, Steel)<br />

source ©: BrightTALK<br />

41<br />

038-041 Why IoT Projects Fail-JC.indd 41 26.04.22 13:10


<strong>Smart</strong> Business Industrial IoT<br />

42


Industrial IoT<br />

How to Eat<br />

the IIoT Elephant<br />

Learn, through two useful examples, how to start simple and<br />

move to more complex Industrial IoT implementations.<br />

n By Göran Appelquist*<br />

Moving to Industrial IoT<br />

can be a challenge.<br />

Through working on<br />

many customer projects<br />

over a number of years at<br />

Crosser, we have learnt that a<br />

key success factor is to start with<br />

small projects that are quick and<br />

easy to implement before gradually<br />

building up to the more advanced<br />

and complex use cases.<br />

That is, always eat the elephant<br />

in pieces, don’t try to swallow it<br />

whole.<br />

In most cases it is possible to find<br />

small and simple projects that are<br />

good starting points requiring<br />

a low effort to implement while<br />

returning value quickly. With the<br />

right tools it is easy to start simple<br />

and then add more advanced features<br />

over time.<br />

Simple Beginnings<br />

Here are some simple but useful<br />

projects, showing how they can<br />

be implemented with Crosser’s<br />

Edge Streaming Analytics. The<br />

How to get There<br />

From Here<br />

Data mismatch is a<br />

common problem in<br />

IoT. Therefore, data<br />

transformation and<br />

harmonisation play a<br />

major role.<br />

Crosser system provides a large<br />

library of pre-made building<br />

blocks (modules) that implement<br />

common functionalities for these<br />

types of use cases. By using these<br />

modules, it is easy to get started<br />

by combining modules into applications<br />

using a graphical drag<br />

and drop editor. With the interactive<br />

debugging capabilities, each<br />

application can be verified before<br />

installing them for continuous<br />

operation on Crosser Nodes that<br />

have been installed near the<br />

source ©: Crosser Technologies<br />

*Göran Appelquist is CTO at Crosser, an IIoT specialist based in Sweden and in Munich, Germany.<br />

43


<strong>Smart</strong> Business Industrial IoT<br />

systems with which they will interact.<br />

source ©: Crosser Technologies<br />

System Availability<br />

Monitoring system availability is<br />

a very common requirement. This<br />

kind of application can be created<br />

by starting with a time trigger<br />

that will fire the application<br />

once every minute, or whatever<br />

time period makes sense. A call is<br />

made to the system to be monitored,<br />

for example a programmable<br />

logic controller (PLC) or a representational<br />

state transfer (REST)<br />

endpoint. If the request fails, a<br />

notification is sent to someone<br />

using a text messaging service.<br />

Here a Modbus PLC is being<br />

polled every minute and, if no<br />

response is detected, text messages<br />

will be sent to the managers’<br />

mobile phones using the<br />

Twilio messaging service. This is,<br />

of course, a very basic application<br />

but, if failures are not expected<br />

too often, it could still be useful.<br />

The same concept can be used<br />

with any system that accepts an<br />

external request. For example, if<br />

an HTTP endpoint has to be monitored,<br />

the Modbus module can<br />

easily be replaced with an HTTP<br />

request module.<br />

When the monitor is up and running,<br />

ways to improve it can be<br />

considered. One obvious problem<br />

is that a message will be triggered<br />

every minute if the PLC stays in an<br />

unresponsive state – which could<br />

Always eat the<br />

elephant in<br />

pieces - don't<br />

try to swallow it<br />

whole!<br />

Göran Appelquist<br />

Crosser<br />

be quite annoying. It’s easily fixed<br />

just by adding a Report By Exception<br />

module so that a message is<br />

sent only when the PLC initially<br />

becomes unresponsive.<br />

If the PLC is a bit shaky, flipping<br />

back and forth between online<br />

and offline, the monitor may once<br />

again send more messages than<br />

necessary. Another easy fix is to<br />

add a Throttle module to make<br />

sure only one message is sent per<br />

hour (or whatever duration is suitable).<br />

Finally, it might be desirable to<br />

get availability statistics captured<br />

over a long timespan. Here, the<br />

Time Counter module can be<br />

used to take the same input as<br />

before to provide a summary of<br />

the times spent in each state over<br />

a specified period. The results can<br />

be sent as an uptime report once<br />

per day.<br />

The new generation<br />

integration platform<br />

allows you to integrate<br />

any device or machine<br />

data and any data<br />

source with smart<br />

workflows, events and<br />

triggers in real time.<br />

The project started with something<br />

really simple, but still<br />

useful, and then it was gradually<br />

improved to finally arrive at<br />

something that now has more<br />

functionality. The development<br />

team can decide how much further<br />

to take it and at what pace.<br />

Integrity Checking<br />

Data integrity is a broad concept<br />

with many possible applications,<br />

such as checking that values are<br />

within reasonable limits, counters<br />

are constantly incremented, or<br />

that data is updated at a certain<br />

rate.<br />

The latter case will be used here,<br />

checking that sensor data is updated<br />

at the expected rate. For<br />

this example, a subscription must<br />

be set up against an open platform<br />

communications unified<br />

architecture (OPC-UA) server that<br />

source ©: Crosser Technologies<br />

44


Guidelines<br />

The examples given share some characteristics<br />

that can serve as general<br />

guidelines when trying to identify other<br />

projects that are good starting points<br />

for edge analytics:<br />

•<br />

Find use cases that are add-ons<br />

to the existing operation, that is,<br />

ensure that neither the input nor the<br />

output systems rely on the operation<br />

of the business critical application<br />

to which they are attached.<br />

•<br />

Find uses that add value when they<br />

work but won’t have a major negative<br />

impact if they don’t.<br />

•<br />

For the first implementation, try<br />

to scale down the problem to an<br />

absolute minimum, while still adding<br />

value (minimum viable product).<br />

Then incrementally add features until<br />

the final goal has been reached.<br />

•<br />

Build an application that solves<br />

the problem when everything<br />

works normally, known as a ‘happy<br />

path’ implementation. Then add<br />

additional logic later to cover situations<br />

where things don’t work as<br />

expected.<br />

will then push back changes in<br />

values and these results will be<br />

checked every second by using a<br />

Timeout module.<br />

The Timeout module has to be<br />

set to check there are no changes<br />

within periods of 70 seconds rather<br />

than 60 seconds, chosen to offer<br />

a margin for small deviations<br />

in update frequency. This module<br />

can monitor any number of sensors<br />

and, as soon as one of them<br />

fails to deliver data in time, it will<br />

indicate which sensor has failed.<br />

In this project, the application will<br />

make an HTTP request when a sensor<br />

fails, maybe calling on the enterprise<br />

resource planning (ERP) or<br />

manufacturing execution systems<br />

(MES) to trigger further actions.<br />

With this very simple flow, thousands<br />

of sensors can be monitored<br />

as long as they have the<br />

same expected data rate. If the<br />

Getting There<br />

Build integration<br />

flows with the Flow<br />

Studio using a<br />

library of modules<br />

and connectors.<br />

Add data mapping,<br />

data transformation,<br />

triggers<br />

and events to your<br />

flows with ease.<br />

sensors, or groups of sensors,<br />

have different data rates, multiple<br />

Timeout modules can be added<br />

with differing timeout settings<br />

using a filter on each to allow the<br />

relevant sensors to be selected:<br />

These two simple but realistic use<br />

cases are good starting points for<br />

introducing edge streaming analytics.<br />

It’s possible to find many<br />

alternative but equally simple examples<br />

within any organisation.<br />

source ©: Crosser Technologies<br />

45


<strong>Smart</strong> Communications Trucking & IoT<br />

Trucking & IoT<br />

Delivering<br />

a Revolution<br />

Artificial intelligence, advanced robotics and the Internet of Things<br />

are poised to spark a revolution in the automobile industry.<br />

Automated cars have grabbed the headlines in recent years but<br />

most analysts, quite reasonably, believe<br />

that freight trucks will be the first fully-automated<br />

vehicles in regular use on the roads.<br />

n By Tim Cole*<br />

46<br />

*Tim Cole is editor of <strong>Smart</strong> <strong>Industry</strong>.


The trucking industry, and the<br />

logistics that keep it running,<br />

has become fundamental to<br />

the success of supply chains,<br />

both nationally and internationally.<br />

Without those supply chains running<br />

smoothly, allowing for just-intime<br />

orders and millions of successful<br />

daily deliveries, industries of all<br />

types would grind to a halt.<br />

The Brexit situation, with Great<br />

Britain withdrawing from the European<br />

Union, is a perfect example<br />

of the kind of chaos a broken supply<br />

chain can create. In the fall of<br />

2021, cars and trucks were lining up<br />

in front of empty pumps at UK gas<br />

stations, and supermarket shelves<br />

remained barren, all for the lack<br />

of truckers. A Road Haulage Association<br />

(RHA) survey of its members<br />

estimates there is now a shortage<br />

of more than 100,000 qualified drivers<br />

in the UK. That number includes<br />

thousands of drivers from European<br />

Union (EU) member states who were<br />

previously living and working in the<br />

UK. Issues such as this highlight the<br />

importance of the trucking industry.<br />

Time is of the Essence<br />

Yet geopolitical issues such as this<br />

are far from the only challenges<br />

currently facing freight and haulage,<br />

with market demands shifting<br />

quickly and shipments growing accordingly.<br />

In America, a report by<br />

the Federal Motor Carrier Safety<br />

Administration (FMCSA) said there<br />

were approximately 493,730 trucking<br />

companies in the US alone. Even<br />

today, most of the small business<br />

owners in the US are truckers. So,<br />

as this industry grows, it becomes<br />

necessary to track several statistics<br />

in real-time. Factors like the load on<br />

the trucks, time required for loading<br />

and unloading of goods, traffic<br />

on the travel routes, or tracking the<br />

vehicles in real-time are important<br />

to the fleet managers and truck<br />

owners of the businesses.<br />

These issues have put trucking<br />

front and centre in the eyes of those<br />

seeking industry disruption, resulting<br />

in seismic changes to the way<br />

trucking works. As with so many<br />

The driver<br />

situation is<br />

about as bad<br />

as I've ever<br />

seen it in my<br />

career.<br />

Help Wanted<br />

A Road Haulage<br />

Association (RHA)<br />

survey estimates<br />

there is now a<br />

shortage of more<br />

than 100,000<br />

qualified drivers in<br />

the UK alone.<br />

Eric Fuller<br />

CEO of U.S. Xpress<br />

other key industries in transition, it’s<br />

the Internet of Things (IoT), AI, and<br />

robotics that are leading the way<br />

and providing truly remarkable solutions<br />

to ever-growing problems.<br />

IoT has connected sensors, electronic<br />

monitors, actuators, GPS receivers,<br />

RFID systems, beacons, and<br />

so on, with a network of physical<br />

devices, appliances, vehicles, and<br />

other items for data collection and<br />

communication. In transportation<br />

and trucking, it has provided several<br />

promising solutions to develop<br />

powerful new applications and systems.<br />

When an AI-driven, long-haul<br />

industry is in place, it’s not difficult<br />

to imagine the rest of the automotive<br />

industry catching up.<br />

IoT-based solutions are transforming<br />

the trucking industry in unbelievable<br />

ways. They assure better<br />

transparency, higher operational efficiency<br />

and enhanced security – ultimately<br />

increasing profit margins.<br />

Time taken to fill last HGV driver vacancy<br />

1-2 weeks<br />

2-4 weeks<br />

4-6 weeks<br />

6-8 weeks<br />

8+ weeks<br />

0% 10% 20% 30%<br />

"Not applicable" not shown<br />

source ©: Road Haulage Association source ©: Scenic Roots<br />

47


<strong>Smart</strong> Communications Trucking & IoT<br />

source ©: Intel Corporation<br />

Trucks, which have sensors connected,<br />

travel via different routes and, at<br />

various location transmission hubs,<br />

collect and send data to the decisionmakers<br />

for the insights that help in<br />

gaining better results.<br />

Here’s a closer look at ways in which<br />

IoT and AI technology is transforming<br />

the trucking industry and how<br />

the industry will benefit from justin-time<br />

trucking and logistics.<br />

Keeping Track of<br />

Truckers<br />

Electronic Logging<br />

Devices, or ELDs, are<br />

now mandatory for<br />

commercial drivers<br />

who are required to<br />

prepare hours-ofservice<br />

(HOS) records<br />

of duty status,<br />

further increasing<br />

pressure on trucking<br />

companies who<br />

need to hire more<br />

drivers to comply.<br />

Loads of Problems<br />

Data produced by<br />

hundreds of sensors<br />

on commercial trucks<br />

is fused together in<br />

real-time to get meaningful<br />

information that<br />

optimises safety, fuel<br />

economy, and maintenance<br />

of the vehicle.<br />

Intelligent Data Driving Performance<br />

Feb16, 2016 - Dec 18, 2017<br />

Phase 1<br />

Completed<br />

Dec 18, 2017 - Dec 16, 2019<br />

Phase 2<br />

After Dec 16, 2019<br />

Phase 3<br />

A Phased Approach<br />

As the ELD rule is implemented,<br />

motor carriers will be allowed<br />

time to transition to full<br />

adoption of ELDs. This table<br />

illustrates which recording<br />

methods are acceptable during<br />

each phase implementation.<br />

ever, as the robot systems become<br />

more skilled on their routes, a future<br />

of completely driverless fleets<br />

of trucks is easily foreseeable.<br />

Fuel, insurance and drivers’ wages<br />

are obviously the trucking industry’s<br />

key expenses. By tracking the<br />

locations, driving habits and speed<br />

of the trucks in a fleet, expenses can<br />

be managed more successfully and<br />

efficiently. A combination of Big<br />

Data, AI, and IoT devices will make<br />

Awareness and Transition Phase<br />

During this time, carriers and drivers subject to the rule could<br />

prepare to comply and voluntarily use ELDs.<br />

Carriers and drivers subject to the rule could use any of<br />

the following for records of duty status (RODS):<br />

Paper logs | Logging software | AOBRDs<br />

ELDs that are self-certified and registered with FMCSA<br />

Phased-In Compliance Phase<br />

The two-year period from the Compliance Date to the<br />

Full Compliance Phase. Carriers and drivers subject to<br />

the rule can use:<br />

AOBRDs installed and in-use prior to December 18, 2017<br />

ELDs that are self-certified and registered with FMCSA<br />

Full Compliance Phase<br />

All drivers and carriers subject to the rule must use<br />

self-certified ELDs that are registered with FMCSA.<br />

ELD<br />

AOBRD<br />

Logging<br />

Software<br />

Paper<br />

Phase 1<br />

Phase 2 Phase 3<br />

Drivers and carriers exempt from the ELD rule may continue to<br />

use any of these methods of record keeping to log their HOS date.<br />

source ©: FMCSA<br />

Safety First<br />

The best argument for introducing<br />

automated vehicles and AI-driven<br />

trucks is the fact that they are safer<br />

for everyone. Long-distance routes<br />

that demand long hours of high<br />

intensity focus and alertness are<br />

dangerous for both the truck driver<br />

and other travelers. Reliable and accurate<br />

AI systems help reduce the<br />

risk of accidents, while reducing the<br />

pressure on the drivers themselves.<br />

The trucking industry is in the midst<br />

of a hiring crisis. “The driver situation<br />

is about as bad as I’ve ever seen<br />

in my career,” Eric Fuller, the CEO of<br />

U.S. Xpress, told Yahoo Finance.<br />

It’s a hard job, and fewer people are<br />

attracted to it. At the same time,<br />

demand for haulage is growing by<br />

leaps and bounds. More autonomous<br />

trucks wouldn’t merely increase<br />

staff safety, they’d also help<br />

resolve capacity issues. Currently,<br />

autonomous trucks still require<br />

human drivers in the cockpit. Howthis<br />

happen more easily and accurately<br />

than ever before and will only<br />

require giving each driver an Electronic<br />

Logging Device (ELD) as part<br />

of their smartphone setup.<br />

In 2015, Saia LTL Freight, a reputed<br />

trucking company in America, installed<br />

sensors in their trucks for<br />

tracking fuel consumption, maintenance<br />

needs and other performance<br />

metrics. This raised the fuel<br />

efficiency of the company by 6 percent<br />

saving millions of dollars.<br />

IoT technology already plays a key<br />

role when it comes to overseeing<br />

the performance of factory equipment<br />

in the manufacturing industry,<br />

highlighting when parts need<br />

replacing and keeping an eye on<br />

the smooth running of key components.<br />

There’s no reason why<br />

the same IoT data and technology<br />

couldn’t be applied to the trucking<br />

industry by installing sensors to anticipate<br />

issues before they arise or<br />

when vehicles need servicing.<br />

This is a particularly attractive concept<br />

for trucking-business owners<br />

and investors. Most of these companies<br />

can run up mountainous annual<br />

repair bills, as high as $15,000<br />

48


per vehicle plus another $4,000 for<br />

tires. Many of the issues that arise<br />

could be spotted earlier using IoT<br />

technology. Cast in this light, smart<br />

trucks would save an immense<br />

amount of money while creating<br />

safer, more efficient fleets at the<br />

same time.<br />

This aspect of AI, called predictive<br />

maintenance, allows problems to<br />

be addressed before they become<br />

severe (and more expensive), generating<br />

both peace of mind and<br />

a better ROI in the process. It’s no<br />

wonder that the vast majority of<br />

trucking business owners firmly believe<br />

that IoT technology is fundamental<br />

to their future success.<br />

Staying Fresh<br />

Sensitive cargo, such as plants and<br />

flowers or time-sensitive perishable<br />

goods, have long been a source of<br />

headaches for the entire industry.<br />

IoT technology can automatically<br />

adjust variables like temperature<br />

and humidity in order to ensure<br />

optimal conditions for such cargo.<br />

Furthermore, it can help drivers<br />

select the best routes, taking into<br />

account road conditions, construction<br />

zones and accidents to ensure<br />

a timely and well-preserved delivery,<br />

both of which are critical for<br />

consistently happy customers.<br />

In the home package delivery industry<br />

(UPS and FedEx), the ability<br />

to track individual items has already<br />

led to increased customer satisfaction.<br />

AI and IoT advancements will<br />

allow this same functionality to be<br />

applied to commercial trucking.<br />

This industry, as much as any, can<br />

use all the trust it can find in order to<br />

future proof it for decades to come.<br />

Last-mile deliveries and just-in-time<br />

services are on the increase, which<br />

means that every second makes a<br />

difference in logistic success rates.<br />

Robots working alongside personnel<br />

in warehouses or working independently<br />

and fully automated,<br />

have already made significant improvements<br />

in efficiency and timesaving<br />

procedures.<br />

Speedier loading and unloading<br />

times allow trucks to complete<br />

more orders in a day. We’re already<br />

seeing the latest robotics technologies<br />

implemented in warehouses<br />

run by companies, such as FedEx,<br />

with impressive results. Automation<br />

in the warehouse is another<br />

way to mitigate issues caused by<br />

worker shortages and offers another<br />

key investment area that could<br />

save the industry millions.<br />

An example of IoT-based solutions<br />

for the trucking industry is App-<br />

Weigh. It is a specially designed<br />

mobile app which uses Bluetoothenabled<br />

weight sensors to measure<br />

the load on air suspension trucks<br />

and trailers throughout shipment.<br />

The truck weight is directly sent to<br />

the drivers on their smartphones<br />

to keep them informed and ensure<br />

their trucks and goods are safely<br />

and legally loaded to their destination.<br />

This app can be useful to<br />

individual truck owners as well as<br />

Weighing In<br />

AppWeigh is a Bluetooth<br />

weight sensor<br />

and app for air suspension<br />

trucks and<br />

trailers that displays<br />

truck weight on a<br />

smartphone to help<br />

truckers load safely<br />

and legally.<br />

transportation and trucking companies<br />

as they alert the drivers and<br />

managers when the weight in the<br />

vehicle crosses the permissible limit<br />

and enables them to take immediate<br />

action.<br />

Endless Potential<br />

There’s no questioning the fact that<br />

robotics, IoT and AI have already<br />

enabled, and will continue to facilitate,<br />

disruption in the trucking<br />

industry, helping business owners<br />

save time and money, while staying<br />

on top of a rapidly changing and<br />

often unpredictable sector. Datadriven<br />

and tech-centric developments<br />

have been the catalysts for<br />

the digital transformation currently<br />

underway within trucking. From all<br />

indications, it appears the industry<br />

will act as a bellwether for the<br />

future of automated vehicles and<br />

logistics.<br />

While many of the technological advances<br />

predicted for the trucking industry<br />

remain in their earliest stages,<br />

it’s clear that the business of trucking<br />

has responded positively and is<br />

quick to adopt the latest IoT developments.<br />

With the potential to<br />

source ©: SKT Technologies Inc.<br />

49


<strong>Smart</strong> Communications Trucking & IoT<br />

become a bonafide, high-tech sector,<br />

the trucking industry is breaking<br />

new technological ground.<br />

Drivers need to follow strict government<br />

regulations. To comply<br />

with the Electronic Logging Device<br />

(ELD) mandate, all trucks must be<br />

equipped with electric devices in<br />

their trucks to track their working<br />

hours and activities. Legally, drivers<br />

can’t drive for more than 10 hours<br />

a day, requiring them to log working<br />

hours. With the adoption of IoT,<br />

trucking companies can easily comply<br />

with this law.<br />

Is This What the Future<br />

Looks Like?<br />

Resembling the helmet of<br />

a Star Wars stormtrooper,<br />

a driverless electric truck<br />

recently began daily<br />

freight deliveries on a<br />

public road in Sweden,<br />

in what developer Einride<br />

and logistics customer DB<br />

Schenker described as a<br />

world first.<br />

troubleshooting without having<br />

to carry well-thumbed, dog-eared<br />

manuals.<br />

Reactions to such advances are<br />

mixed. While up to 65 percent of<br />

transport executives hail automation<br />

and IoT-driven trucking as<br />

nothing short of a renaissance for<br />

the industry, there are legitimate<br />

concerns. There is a real risk of job<br />

losses – a common fear whenever AI<br />

is mentioned. There are also security<br />

concerns regarding the onboard<br />

networks of autonomous trucks<br />

being hacked by cybercriminals,<br />

though advances in anonymity networks<br />

have mitigated those risks.<br />

Yet even staunch critics admit that<br />

the benefits of IoT and AI in trucking<br />

outweigh the mostly theoretical<br />

drawbacks. IoT is a secure, reliable<br />

and cost-effective way to boost the<br />

bottom line of trucking businesses.<br />

The revolution will roll on.<br />

Not a Sound<br />

Scientists at the University<br />

of Michigan<br />

have demonstrated<br />

how sound waves<br />

can be used to<br />

detect and prevent<br />

malicious acoustic<br />

interference with<br />

autonomous truck<br />

systems.<br />

Faster, Faster!<br />

IoT-linked trucks also help the drivers<br />

to do their jobs faster and with<br />

enhanced safety, thus putting<br />

an end to the seemingly endless<br />

queues at gas stations around the<br />

world and speeding up delivery of<br />

food and other essentials. IoT saves<br />

the drivers from paperwork by electronically<br />

updating the fleet managers<br />

about delivery timings, loading<br />

weights and other operational<br />

data. Drivers can also be informed<br />

in advance about diversions, offduty<br />

hours, traffic timings, bad<br />

weather and other relevant information.<br />

When trouble strikes, they<br />

can also get assistance regarding<br />

source ©: University of Michigan<br />

50


That’s why you need storage built to<br />

capture it right where it’s generated<br />

Western Digital is a leader in storage solutions designed and tested to stand up to demanding<br />

IoT and industrial applications. These durable storage devices in a range of capacities are built<br />

for extreme temperatures and environments, and make remote monitoring a breeze.<br />

Embedded<br />

Removable<br />

SSD PCIe<br />

SSD SATA III<br />

Learn more at www.westerndigital.com<br />

Western Digital, the Western Digital logo, and iNAND are registered trademarks or trademarks of Western Digital Corporation or its affiliates in the U.S. and/or other countries.<br />

microSD is a trademark or registered trademark of SD-3C, LLC in the United States and/or other countries. All other marks are the property of their respective owners. As used<br />

for storage capacity, 1 gigabyte (GB) = one billion bytes, and 1 terabyte (TB) = one trillion bytes. Total accessible capacity varies depending on operating environment. Product<br />

specifications subject to change without notice. Pictures shown may vary from actual products. © <strong>2022</strong> Western Digital Corporation or its affiliates. All rights reserved.


<strong>Smart</strong> Business Network Transformation<br />

Network Transformation<br />

Taking Security<br />

to the Edge<br />

52<br />

The ongoing digitisation of the workplace and the rise of the distributed<br />

workforce is forcing companies to redefine the security of their IT infrastructure.<br />

Secure Access Service Edge, or SASE, is a holistic security architecture<br />

combining both network and security services in a software-defined cloud<br />

architecture which may provide the answer to these challenges.<br />

n By Sebastian Ganschow


for branch offices that were connected<br />

directly to the data center,<br />

where internal applications were<br />

hosted and Internet traffic could<br />

be filtered. But with working from<br />

home becoming an option for<br />

many employees, apps and data<br />

need to be dispersed across locations.<br />

IT teams face the challenge of<br />

providing secure, authorised access<br />

while maintaining quality of experience<br />

across any device and location.<br />

Network Security Meets<br />

Security at the Edge<br />

The Secure Access Service Edge, or<br />

SASE model is becoming increasingly<br />

important for many large organisations.<br />

Already, 24 percent of<br />

enterprises plan to develop strategies<br />

to implement the SASE approach<br />

outlined by Gartner, a consultancy,<br />

by 2024 at the latest.<br />

SASE is a cloud-centric architecture<br />

that represents a convergence<br />

of software-defined wide<br />

area networking (SD-WAN) and<br />

high security in a strategic edgeto-cloud<br />

service that adds neither<br />

hardware cost nor complexity. In<br />

other words, SASE describes an<br />

architecture that delivers network<br />

services and security functions<br />

as cloud services where they are<br />

needed: On end devices and at the<br />

SASE<br />

facilitates a<br />

better<br />

response<br />

to internal<br />

and external<br />

changes.<br />

Sebastian Ganschow<br />

is Director Cybersecurity<br />

Solutions at NTT Ltd.<br />

The End of Point<br />

Solutions<br />

SASE combines<br />

the functions of<br />

network and security<br />

point solutions in a<br />

unified, global cloudnative<br />

service, with<br />

a profound impact<br />

on several IT areas<br />

at once.<br />

edge, where a permanent connection<br />

to networks is not possible or<br />

even necessary.<br />

Although each company is taking<br />

a different path, a strategic SASE<br />

vision includes both a fundamental<br />

shift in access controls to where<br />

they are needed - the end user and<br />

the cloud edge – and the search<br />

for less complexity. Convergence<br />

of security functions in an efficient<br />

as-a-service model are a good way<br />

to achieve these goals.<br />

In addition, SASE can focus on<br />

supporting business agility to respond<br />

to all internal and external<br />

changes, while at the same time<br />

simplifying deployment, management,<br />

and enforcement of<br />

source ©: IDG Business Media GmbH<br />

SD-WAN<br />

Carrier<br />

Network Security<br />

Large enterprises still operate<br />

huge data centres. These<br />

contain not only local SaaS<br />

(Software-as-a-Service) applications,<br />

but also network components<br />

such as firewalls, load<br />

balancers, intrusion detection and<br />

prevention systems, routers and<br />

switches. Just a few years ago, it<br />

was common to design networks<br />

WAN<br />

Optimization<br />

Bandwidth<br />

Aggregation<br />

Networking<br />

Vendors<br />

Network as a<br />

Service<br />

Network<br />

CDN<br />

SASE<br />

Security<br />

DNS<br />

CASB<br />

Cloud SWG<br />

ZTNA/VPN<br />

WAAPaaS<br />

FWaaS<br />

RBI<br />

source ©: Inseya AG<br />

53


<strong>Smart</strong> Business Network Transformation<br />

a range of professionals - network<br />

engineers, application developers<br />

and security specialists. For some<br />

organisations, this means requiring<br />

a common working language between<br />

IT and security departments<br />

for the very first time.<br />

In addition, organisations need to<br />

include strategic stakeholders such<br />

as human resources, access mansource<br />

©: Musarubra US LLC<br />

policies across the board. SASE as<br />

a "secure-by-design" interface for<br />

network and cybersecurity aims at<br />

breaking down silos in order to deliver<br />

seamless, scalable, and secure<br />

Internet and cloud access anytime,<br />

anywhere.<br />

Adopting SASE requires a convergence<br />

of skills and capabilities and a<br />

new level of collaboration between<br />

The Quickest Route<br />

to SASE<br />

Decision makers seek a<br />

faster, more efficient high<br />

road to cloud and network<br />

transformation without compromising<br />

security. The need<br />

for speed and scalability is<br />

crucial, but corners cannot<br />

be cut when it comes to<br />

maintaining data and threat<br />

protection.<br />

Centralised Management<br />

with less Complexity<br />

Many organisations begin their<br />

SASE journey by introducing a centralised<br />

way to manage policy creation<br />

and monitoring. In the next<br />

step, they implement advanced security<br />

services from the data centre<br />

to each cloud required by the site,<br />

user or IoT device. By combining<br />

multiple security capabilities into<br />

a single cloud-native service, CIOs<br />

and CISOs can build greater centralised<br />

management capability with<br />

less complexity. Thus, SASE effects<br />

more than just technology conver-<br />

agement and compliance officers<br />

in the conversation. Only then can<br />

they define advanced policies for<br />

data loss prevention (DLP), cloud<br />

access security brokers (CASBs) and<br />

zero trust network access.<br />

A SASE approach requires the integration<br />

of multiple security and IT<br />

services from an organisation's first<br />

line of defense, to a DNS layer, to a<br />

secure web gateway for zero trust<br />

that enables deeper inspection, to a<br />

cloud firewall that protects web and<br />

non-web traffic.<br />

Expectations<br />

Multicloud Networking<br />

LEO Satellite Systems<br />

Software-Defined Cloud Interconnect<br />

Kubernetes Networking (CNI)<br />

AIOps Platforms<br />

Network Observability<br />

Enhanced Internet<br />

Wi-Fi 7<br />

eBPF<br />

Private 5G<br />

FACs (<strong>Smart</strong>NICs)<br />

SASE<br />

NVMe-oF<br />

5G<br />

400 Gbps Ethernet<br />

NaaS<br />

SD-Branch<br />

Network Automation<br />

Open Networking<br />

Service Mesh<br />

IPv6<br />

Wi-Fi 6<br />

SD-WAN<br />

Microsegmentation<br />

New New Path Forward<br />

SASE includes the ability to<br />

be delivered to enterprises as<br />

a managed cloud service, as<br />

well as to shift away from a<br />

traditional box-heavy branch<br />

(i.e., next-generation firewall,<br />

branch routers, etc.) to a thin<br />

branch (with SD-WAN) and a<br />

heavy cloud model.<br />

NDN<br />

6G<br />

Intent-Based Networking<br />

NFV<br />

ZTNA<br />

SDN<br />

source ©: Inseya AG<br />

54<br />

Innovation<br />

Trigger<br />

Peak of Infated<br />

Expectations<br />

Time<br />

Trough of<br />

Disillusionment<br />

Plateau will be reached: 10 yrs. Obsolete before plateau<br />

Slope of<br />

Enlightenment<br />

Plateau of<br />

Productivity<br />

As of July 2021


Traditional Hub-and-Spoke Architecture<br />

Services<br />

Apps<br />

Fast, but Just not<br />

Fast Enough<br />

Conventional<br />

hub-and-spoke<br />

architecture cannot<br />

keep pace with the<br />

escalating demands<br />

of edge-centric<br />

computing.<br />

Internet<br />

B r a n c h<br />

B r a n c h<br />

B r a n c h<br />

Headquarters<br />

D e d i c a t e d B r o a d b a n d<br />

B r a n c h<br />

B r a n c h<br />

B r a n c h<br />

source ©: Infoblox<br />

gence – it’s where business value is<br />

created and protected.<br />

Simplification and security are the<br />

two big drivers for network modernisation.<br />

One of the key benefits<br />

of this new approach is centralised<br />

network monitoring and management.<br />

Regardless of data centre<br />

or network perimeter monitoring,<br />

convergence lowers costs and increases<br />

cross-tier visibility in hybrid<br />

environments.<br />

A common framework for analysing<br />

users, applications, and data<br />

provides a comprehensive understanding<br />

of all issues and allows<br />

for faster resolution. The unified<br />

interface provides far more detailed<br />

and consistent analysis and<br />

reporting, ensuring more expeditious<br />

decision making and efficient<br />

performance management.<br />

SASE builds on the connectivity<br />

benefits of SD-WAN and includes<br />

optimised MPLS, Internet, and<br />

hybrid connectivity, as well as an<br />

integrated security system. It simplifies<br />

branch office networking by<br />

replacing the multitude of network<br />

devices found in many enterprises<br />

with a simple system that provides<br />

access to a wide range of services.<br />

This approach significantly reduces<br />

the time and effort required<br />

for configuration monitoring and<br />

troubleshooting of network and<br />

Getting the Work<br />

Done Faster<br />

Cutting the time<br />

needed to configure,<br />

monitor and troubleshoot<br />

network security<br />

functions is a great<br />

benefit.<br />

security functions. Finally, new<br />

applications or services can be<br />

deployed much faster. This is not<br />

just another argument for automation,<br />

but rather a leap forward in<br />

speedy, granular policy definition<br />

to meet rapidly changing business<br />

needs.<br />

55


<strong>Smart</strong> sensors for<br />

the next automation age<br />

The Automation age describes<br />

an epoch when machines<br />

began to perform<br />

complex tasks with little to<br />

no human interactions. Today we<br />

are experiencing a new type of automation<br />

enabled by the proliferation<br />

systems composed of interconnected,<br />

miniaturized objects and<br />

systems able to sense, process and<br />

take actions. The number of such<br />

devices is growing exponentially<br />

and with increasingly complex functionality,<br />

requiring more powerful<br />

cloud infrastructure. This creates<br />

a need to distribute intelligence,<br />

such as AI processing, throughout<br />

the system. This enables local smart<br />

controls, while helping protect user<br />

privacy and lowering overall system<br />

power consumption.<br />

Combining edge processing with<br />

cloud connectivity brings flexibility<br />

to system design and enables op-


Advertorial<br />

timal balance between offline and<br />

online capabilities. Advanced smart<br />

sensors bring intelligent processing<br />

to the point closest to the data<br />

generation by incorporating this<br />

processing capability into the sensor<br />

itself.<br />

One approach to achieve this is to<br />

equip the sensor with a Machine<br />

Learning Core (MLC) using a Finite<br />

State Machine (FSM) and advanced<br />

digital functions. Instead of using<br />

a microcontroller to process data,<br />

the MLC can run a decision tree, an<br />

inductive algorithm at a fraction of<br />

the power consumption. As a result,<br />

the system can recognize specific<br />

activities or events by observing<br />

movements or state changes and<br />

inferring from predefined patterns.<br />

This approach brings challenges<br />

for system design, particularly in<br />

terms of processing power, packaging,<br />

and power consumption. A<br />

clear challenge for sensor makers<br />

is to add AI processing capabilities<br />

without disrupting their proven solution<br />

for low noise, low power, and<br />

high accuracy - and also without<br />

changing the package form factor.<br />

Keeping the same package as existing<br />

sensors offers system designers<br />

flexibility on sensor selection without<br />

changing board design.<br />

ST has introduced a range of smart<br />

sensors that tackle these challenges<br />

starting with the LSM6DSOX<br />

launched in 2019. These sensors<br />

have a Machine Learning Core incorporated<br />

into the sensor itself with<br />

LSM6DSV16X<br />

and FSM and configurable decision<br />

trees. Our latest products continue<br />

to improve key parameters for<br />

developers such as performanceper-watt<br />

ratio. An example is the<br />

LSM6DSV16X, the newest member<br />

of our family of inertial MEMS with<br />

a machine learning core, launched<br />

earlier this year and available from<br />

mid <strong>2022</strong> .<br />

The LSM6DSV16X also introduces a<br />

new feature called Qvar to the LSM6<br />

family of devices. Engineers only<br />

need to connect two electrodes to<br />

measure variations in quasi-electrostatic<br />

potential and change two<br />

registers to enable the feature. Qvar<br />

opens the door to new applications,<br />

such as people counting. Instead of<br />

using an LED and photodiode, engineers<br />

can place electrodes on walls<br />

and measure if someone walks near<br />

them. The LSM6DSV16X remains<br />

pin-to-pin compatible with the other<br />

members of the LSM6DS family.


<strong>Smart</strong> Business EV Charging<br />

EV Charging<br />

Current Trends<br />

The electric vehicle industry is on its way to market maturity but there are still<br />

twists in the road for stakeholders and customers. From accessibility<br />

and standardisation issues to a lack of convenient and secure payment methods<br />

at charging stations, unresolved issues could still throw a spoke in the wheel<br />

of electric vehicles, leaving full adoption out of reach.<br />

n By Mark McCoy<br />

58


Electric vehicles (EVs) are<br />

cool. They offer a smooth<br />

ride and they’re good for<br />

the environment. For many,<br />

the attraction of EV ownership is<br />

also financial. For example, a 2020<br />

survey by smart charging solutions<br />

provider NewMotion, due to be renamed<br />

Shell Recharge Solutions,<br />

found that 61 percent of EV drivers<br />

were motivated to switch to save<br />

money. If so, what’s keeping them<br />

from widespread adoption?<br />

“The most common issues we see<br />

centre around accessibility and<br />

availability,” says Sjors Martens,<br />

the commercial director of chargepoint<br />

data provider Eco-Movement.<br />

“Charging points that are<br />

private or closed are a nuisance! In<br />

fact, 36 percent of charge points<br />

we receive have either restricted<br />

accessibility or are private. Without<br />

intervention from a company<br />

like ours, they’d be displayed on a<br />

map without any warning.”<br />

As if the automotive industry<br />

didn’t have enough problems already<br />

with eMobility, such as secure<br />

payment methods, concerns<br />

about carbon emissions and urban<br />

pollution are driving the manufacturers<br />

to introduce hybrid and fully<br />

electric powertrains. This work is<br />

being aided by steadily improving<br />

battery and motor technology but<br />

is being held back by the ‘chicken<br />

and egg’ problem of charging the<br />

new vehicles.<br />

To ensure that EVs have the same<br />

freedom to roam as today’s fossilfuel<br />

cars, a few challenges need to<br />

be addressed. Experts agree that<br />

charging has to become faster, the<br />

world’s network of petrol stations<br />

has to be upgraded with electriccharging<br />

facilities, and standalone<br />

charging stations will be necessary<br />

to compensate for the EV’s relatively<br />

limited range.<br />

The obvious answer is to align<br />

all charging points on data standards,<br />

providing EV drivers with a<br />

consistent experience no matter<br />

where they are. But, as Martens explains,<br />

that’s easier said than done:<br />

“Charge point operators are often<br />

source ©: Eco-Movement<br />

too busy focusing on exponential<br />

growth to work on data and standards.<br />

Furthermore, the type of<br />

charging points, definitions and<br />

regulations are vastly different<br />

across Europe alone, which makes<br />

it difficult to align perspectives.”<br />

Local conditions also dictate if<br />

private charging points can be installed,<br />

for example, having a private<br />

parking space at your home<br />

is the norm in Belgium but it’s still<br />

the exception in next-door Netherlands.<br />

Even so, resistance to EVs seems to<br />

defy logic. Even a simple back-ofthe-envelope<br />

calculation suggests<br />

that filling your tank with petrol is<br />

Charging<br />

points that<br />

are private<br />

or closed are<br />

a nuisance!<br />

Sjors Martens<br />

Eco-Movement<br />

A Winning Team<br />

Dutch ESS provider Alfen<br />

teamed up with fuel vendor<br />

Shell to deploy a 350kWh<br />

battery storage system at a<br />

forecourt in Zaltbommel, the<br />

Netherlands, offering gridbalancing<br />

services.<br />

like connecting your car to a 5MW<br />

energy source. By contrast, Tesla<br />

announced in March 2019 that<br />

its V3 Superchargers will deliver<br />

energy at rates of up to 250kW, although<br />

it will take a liquid-cooled<br />

charging cable to make it possible.<br />

EV charging obviously has a way<br />

to go before it can catch up with<br />

internal combustion engines in<br />

terms of convenience and practical<br />

reliability. It will take a combination<br />

of high voltages, high<br />

currents and sophisticated power<br />

conversion, filtering and charge<br />

management systems to close<br />

the gap. This, in turn, will demand<br />

the deployment of some pretty<br />

sophisticated connectors, cables,<br />

relays, conversion electronics and<br />

passives to ensure the same kind<br />

of fast, safe energy top-up offered<br />

by today’s petrol stations.<br />

Charging Network Growth<br />

So how close are we to a nationwide<br />

charging network that drivers<br />

can rely on when they need it,<br />

rather than having to hopscotch<br />

between charging stations? Tesla<br />

claimed it had more than 12,000<br />

Superchargers in North America,<br />

Europe and Asia at the end of 2021.<br />

This would cover more than 99<br />

source ©: Alfen N.V.<br />

59


<strong>Smart</strong> Business EV Charging<br />

The EV market Protocols<br />

percent of the US population and<br />

the company expects to achieve<br />

similar distribution in Europe by<br />

the end of this year. Tesla also<br />

claims that it recently achieved<br />

coverage of more than 90 percent<br />

of the Chinese population.<br />

Building charging networks looks<br />

like it will be big business. A report<br />

from Markets and Markets foresees<br />

that EV charging stations will<br />

grow from $3.22 billion in 2017 to<br />

$30.41 billion by 2023, an annual<br />

growth rate of 41.8 percent. The<br />

report offers a number of justifications<br />

for its forecast, including<br />

subsidy programmes for purchasing<br />

EVs in various countries, and a<br />

US government initiative to develop<br />

48 charging networks that will<br />

together cover about 25,000 miles<br />

(40,000 kilometres) of US highways<br />

across 35 states. This initiative led<br />

28 states, utilities, charging firms<br />

and electric vehicle companies,<br />

including GM, BMW and Nissan, to<br />

start working together.<br />

AC or DC?<br />

These raw numbers appear encouraging<br />

for potential EV drivers<br />

but mask the fact that there is still<br />

a lot of variety in charging methods,<br />

the infrastructure available<br />

to support them and, therefore,<br />

TSO<br />

System Operator<br />

• eclearing.net<br />

• Gireve<br />

• Hubjet<br />

Common Cause<br />

The evRoaming4EU consortium<br />

is a partnership project<br />

aimed at ensuring that<br />

any EV driver will be able<br />

to charge at any charging<br />

station in the EU. Its goal<br />

is to address and resolve<br />

functional, technical,<br />

legal, and fiscal obstacles<br />

that exist today between<br />

different countries within<br />

the European Union and<br />

create a mature European<br />

market for EV charging.<br />

infrastructure.<br />

Hub<br />

Roaming<br />

Platform<br />

DSO<br />

Grid Operator<br />

Sustaiable Home /<br />

<strong>Smart</strong> Home<br />

A Growing Market<br />

The EV charger market<br />

in Europe alone reached<br />

1.7 million in 2020,<br />

says IHS, and further<br />

explosive growth is to be<br />

expected over the next<br />

few years.<br />

OCPI (Hub)<br />

OCHP<br />

OICP<br />

eMIP<br />

OSCP<br />

MSP<br />

Service<br />

Provider<br />

OCPI (P2P)<br />

Adm<br />

CPO<br />

Tech<br />

CPO<br />

their usability to the average user.<br />

One big issue has the potential to<br />

reignite the legendary War of the<br />

Currents between Thomas Edison<br />

and George Westinghouse in<br />

the late 1880s and early 1890s.<br />

Edison’s arc lamp street lighting<br />

system ran on low-voltage direct<br />

current (DC), while Westinghouse<br />

championed the rival alternating<br />

current (AC) power distribution<br />

network, which ultimately<br />

triumphed – but not before the<br />

two engineers-turned-entrepreneurs<br />

threw mud at each other,<br />

with Edison even going so far as<br />

to equate Westinghouse and his<br />

system with the electric chair.<br />

The real difference between the<br />

two charging strategies is where<br />

EV driver<br />

OCPP<br />

ISO 15118<br />

Charging Point<br />

Open ADR/<br />

IEC 61850<br />

Energiy Supplier<br />

the necessary transformation is<br />

done. Electric grids deliver AC<br />

which needs to be rectified to the<br />

appropriate DC charging voltage<br />

with the help of technology built<br />

into the car itself. DC charging<br />

stations, on the other hand, use<br />

larger, more efficient and bettercooled<br />

rectification circuitry than<br />

would be possible in a vehicle.<br />

Many predict that, over time, AC<br />

charging stations will do their<br />

own rectification but the jury is<br />

still out.<br />

In addition to charging power,<br />

the decision to use either AC or<br />

DC charging also depends on<br />

the capital costs of rectification<br />

and who will pay: the operators<br />

of the DC charging networks or<br />

source ©: Netherlands Enterprise Agency<br />

Global Cumulative Charging Station Deployments (2014 – 2020)<br />

source ©: IHS Automotive<br />

60<br />

14<br />

12<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

2011 2012 2013 2014 2015 2016 2017 2018 2019 2020


the owners of e-vehicles charged<br />

with AC. Some charging standards<br />

also allow bi-directional<br />

energy flow, so a distributed network<br />

of charging vehicles can<br />

act as both an energy sink and a<br />

source to stabilise the energy grid<br />

– which could lead to regulatory<br />

support in some regions.<br />

While some automobile vendors<br />

like Tesla are trying to control their<br />

customer base by installing proprietary<br />

chargers and connectors,<br />

others like BMW, Mercedes-Benz<br />

maker Daimler, Ford and the Volkswagen<br />

Group, which includes<br />

Audi and Porsche, are all backing<br />

a multi-vendor, multi-technology<br />

standard known as the Combined<br />

Charging System (CCS).<br />

As has been seen multiple times<br />

in other technology evolutions,<br />

the perceived benefits of lock-in<br />

are slowly giving way to standardisation<br />

efforts, as EV customers<br />

begin to demand ubiquitous<br />

charging facilities and weigh their<br />

availability more highly in their<br />

buying decisions. This is leading<br />

to a shake-out in the market<br />

for EV charging. Nissan and Mitsubishi<br />

have backed CHAdeMO<br />

(Charge de Move), which allows<br />

bi-directional charging. China,<br />

the world’s largest EV market, is<br />

establishing GB/T (which means<br />

it’s a favored Chinese regulation)<br />

as its charging standard.<br />

There is obviously still a lot of<br />

room for component manufacturers<br />

to innovate. For example,<br />

if rectification in the vehicle becomes<br />

more efficient, this will<br />

have a direct impact on the utility<br />

of an e-vehicle by enabling faster<br />

charging with AC power. Even the<br />

design of the plug will be a critical<br />

factor in the speed of charging<br />

and all this will help increase the<br />

practical range of an electric vehicle<br />

(see boxout).<br />

Of course, all of these innovations<br />

will have to comply with<br />

national and international standards,<br />

many of which are still being<br />

developed and agreed. As EVs<br />

move ahead to replace fossil-fuel<br />

vehicles, the race for EV market<br />

dominance will almost certainly<br />

be fast and furious.<br />

Interview<br />

How close are we to a nationwide<br />

charging network or maybe<br />

even to a Europe-wide charging<br />

network?<br />

With ISO 15118, we actually have<br />

a pretty good world-wide stansource<br />

©: Thomas Wagner<br />

We need a<br />

faster rollout.<br />

Thomas Wagner<br />

Of in-tech, a pioneer<br />

smart charging company<br />

based in Bavaria<br />

dard, except for China and Japan<br />

which choose to go their own<br />

way. Most companies are working<br />

together because they know<br />

that’s where the future of electromobility<br />

lies, namely in vehicle to<br />

grid and sectoral coupling of energy<br />

and mobility.<br />

Is the energy sector ready?<br />

I think the energy sector needs<br />

to talk more with the mobility<br />

sector, and vice versa. We need<br />

a faster rollout. It’s important<br />

that everyone profits: the manufacturers,<br />

the operators, the end<br />

users, and, of course, both the<br />

charging business and the energy<br />

sector.<br />

What are the biggest priorities<br />

in radically expanding electricvehicle<br />

(EV) charging infrastructure<br />

We need much higher numbers<br />

of charging stations and we need<br />

them much faster as electric vehicle<br />

sales are gaining speed. So I'm<br />

mainly talking about high power<br />

charging parks and also AC charging<br />

at home and at work.<br />

What role will governments play?<br />

After all, many legal standards<br />

and regulations aren’t even fully<br />

developed yet.<br />

Right, national politics has to<br />

support international standards<br />

and international business cases<br />

because EV will be a truly global<br />

market.<br />

61


<strong>Smart</strong> Lifestyle Urban Renewal<br />

Urban Renewal<br />

The<br />

<strong>Smart</strong>est<br />

City<br />

In 2000, Barcelona’s council created 22@ Barcelona<br />

as an urban transformation project with the aim of turning a rundown<br />

industrial area called Poblenou into a new innovation district.<br />

Today, the neighborhood is buzzing with creative startups,<br />

research centres and international businesses and is regularly touted<br />

as an example of urban, economic and social renewal.<br />

62


The Poblenou district of Barcelona<br />

long reflected the wider<br />

malaise of Barcelona. Once<br />

a thriving industrial district<br />

in the 19th Century, it gradually became<br />

the ideal canvas for spraycanwielding<br />

graffitists. Between 1970<br />

and 1990, some 1,300 firms closed,<br />

leaving the area littered with abandoned<br />

buildings: a decaying postindustrial<br />

landscape.<br />

Barcelona’s city council seized the<br />

opportunity offered by the 1992<br />

Olympics to refresh the city. A modern<br />

infrastructure, revamped neighborhoods,<br />

greener parks and a new<br />

two-kilometre sandy beach opened<br />

the city up to the Mediterranean Sea.<br />

The revitalisation made Barcelona a<br />

tourist must-visit destination again.<br />

And Poblenou? It, too, is awakening<br />

from its long sleep to become a<br />

torch bearer for urban renewal.<br />

Much of Poblenou’s renaissance has<br />

been built on IoT systems. Starting in<br />

2012, the city deployed responsive<br />

technologies across public transport,<br />

parking, street lighting and<br />

waste management systems as part<br />

of a <strong>Smart</strong> City Barcelona plan.<br />

Transitioning to a more energyefficient<br />

LED lighting system has<br />

led to cost savings. Sensors in lampposts<br />

identify when pedestrians are<br />

near and dim automatically if the<br />

streets are empty to save energy.<br />

The lampposts form part of a WiFi<br />

source ©: El País<br />

network, too, providing consistent,<br />

city-wide, free connectivity anytime,<br />

anywhere. The network is also integrated<br />

into Sentilo, a system of over<br />

19,500 smart meter sensors that receive<br />

data on weather, pollution and<br />

noise. IoT devices also monitor rain,<br />

humidity and soil moisture in city<br />

gardens. Using the data, gardeners<br />

can remotely programme electrovalves<br />

to deliver any irrigation needed.<br />

This has resulted in savings of approximately<br />

€500,000 per year.<br />

For cars, embedded sensors in parking<br />

bays identify if they are occupied.<br />

Drivers are guided to available<br />

spaces through ApparkB, an app<br />

that allows online payment for parking.<br />

This has reduced congestion<br />

and emissions.<br />

The innovations continue with<br />

smart pneumatic waste bins that<br />

Home to the Future<br />

Ten universities, nine<br />

R&D and technology<br />

transfer centres, and a<br />

spaceship tower,<br />

the 142 m high Torre<br />

Glòries, Barcelona's<br />

new signature skyscraper.<br />

City in the City<br />

The Interface Building,<br />

headquarters of the<br />

Telecommunications<br />

Market Commission,<br />

contains over 42,000<br />

sqm of office space.<br />

reduce odors and new interactive<br />

bus stops, powered by solar panels,<br />

offer USB charging stations and updates<br />

on bus arrivals.<br />

The Knowledge<br />

Neighbourhood<br />

In 2000, €200 million was earmarked<br />

to foster the Barcelona technology<br />

industry. Twenty-two acres of Poblenou<br />

was to be recast as an innovation<br />

district and its name change<br />

said it all. Formerly called 22a (Industrial),<br />

it became 22@ – tagging<br />

it as a digital testing ground. Visit<br />

the district today and any fresh graffiti<br />

will be by renowned local artists,<br />

commissioned by one of the design,<br />

energy, media or scientific research<br />

companies that call 22@ home.<br />

The triangle formed between the<br />

seafront, Avinguda Diagonal and<br />

Ciutadella Park is a hotbed of innovation.<br />

Five universities and academic<br />

institutions have a presence,<br />

and co-working spaces, incubators<br />

and startups abound.<br />

Famous brands present include Amazon,<br />

HP, T-Systems, Ricoh, Schneider<br />

Electrics and Vice Media. Sergio<br />

Ruiz, CEO of the Signaturit Group,<br />

an electronic signature software<br />

company, says the decision to open<br />

in Poblenou was easily made.<br />

“You can really breathe innovation<br />

and technology here,” he explains.<br />

“22@ is a hub that allows us to connect<br />

with other technology companies<br />

and promote innovation. This<br />

allows the development of new opportunities<br />

in our business. It is the<br />

ideal ecosystem for synergies.”<br />

source ©: patrizia.ag<br />

63<br />

source ©: Innovation Academy e.V.


<strong>Smart</strong> Lifestyle Urban Renewal<br />

It is estimated that 4,500 new companies<br />

have come to Poblenou<br />

since 2000. Of these, 47 percent<br />

are startups, and 31 percent are<br />

technology or knowledge-based<br />

companies. Before Covid-19 struck,<br />

around 56,000 tech talents had<br />

been attracted to the area and the<br />

total number of jobs created was<br />

estimated at 150,000.<br />

Old Charm, New Tech<br />

Poblenou is far from a business district<br />

where the lights go out at night.<br />

The redevelopment was not intended<br />

to run slipshod over existing residents<br />

but to make 22@ an appealing<br />

place to live. This included developing<br />

4,000 units of subsidised housing,<br />

creating new green areas, remaking<br />

streets and providing facilities for the<br />

public, such as schools and community<br />

centres.<br />

For this, the support of the real estate<br />

sector was critical. If educated professionals,<br />

tech-savvy workers and other<br />

creatives were to be attracted, they<br />

needed office and living spaces. By<br />

2011, there were 139 plans submitted<br />

for urban redevelopment, 84 from<br />

the private sector.<br />

"What caught our eye was not just<br />

the basic economics and demographics,<br />

it was also that people want<br />

to live there, that the universities are<br />

Cool Quarter<br />

With Poblenou,<br />

Barcelona has succeeded<br />

in rebranding<br />

itself as a city<br />

for business, talent<br />

and innovation.<br />

More Than Green<br />

The 22@Barcelona<br />

project transforms two<br />

hundred hectares of<br />

industrial land of Poblenou<br />

into an innovation<br />

hub. An estimated<br />

4,500 new companies<br />

have come to Poblenou<br />

since 2000. Of these,<br />

47 percent are startups.<br />

expanding, and that 22@ is increasingly<br />

regarded as a smart city," says<br />

Eduardo de Roda, country manager<br />

for Patrizia, an international asset<br />

management company focusing on<br />

innovation technology in the real estate<br />

industry.<br />

On behalf of clients, Patrizia has invested<br />

in five office and residential<br />

buildings. Two are redevelopments<br />

of old industrial space and the goal<br />

is to create sustainable buildings, reflecting<br />

the changing local environment.<br />

“Although 22@ is one of the largest<br />

urban regeneration areas in Europe,<br />

there is still a major shortage of Grade<br />

A office stock. We aim to address that<br />

demand,” says de Roda.<br />

Walk the streets of Poblenou and you<br />

find a lively scene, half bohemian<br />

and half cybernetic. La Rambla del<br />

Poblenou, the promenade that cuts<br />

through the district to the sea, has<br />

been revitalised with top-notch restaurants,<br />

microbreweries and shops.<br />

In the backstreets alternative art galleries,<br />

advertising agencies, architect<br />

firms, dance companies and designer<br />

showrooms burnish the reputation<br />

of Poblenou as Barcelona’s cool new<br />

barrio. It is certainly an eclectic mix.<br />

source ©: Parametric Places: Data Making + Public Space<br />

64


source ©: Patrizia AG<br />

Modernista constructions like the<br />

tubular Torre Glòries and the Design<br />

Museum of Barcelona loom large –<br />

but there has been considerable effort<br />

to preserve the heritage.<br />

Cisco invested $30 million in developing<br />

a co-innovation centre, focused<br />

on the Internet of Everything (IoE),<br />

in a former textile factory. An artistic<br />

colony occupies the Palo Alto Market<br />

area, and the Pompeu Fabra University's<br />

Communication Campus and<br />

From old to new<br />

The former industrial<br />

slum of Poblenou has<br />

been transformed<br />

into the throbbing<br />

heart of a new city by<br />

a mix of careful conservation<br />

and striking<br />

modernisation.<br />

the Fundació Vila Casa Museum are<br />

housed in renovated textile factories.<br />

November 2020 marked the twentieth<br />

anniversary of the 22@ urban<br />

planning project and provided an<br />

opportunity to reassess its direction.<br />

The council plans to open the district<br />

to green companies and more<br />

space was earmarked for 9,300 rental<br />

homes – but this looks like it will be<br />

increased to around 15,800 residential<br />

apartments.<br />

“It is the mix of uses that we like about<br />

22@,” explains de Roda. “How the office<br />

and living spaces are revitalising<br />

the quarter to create a new, dynamic<br />

and compelling lifestyle. That’s the<br />

attraction for the creative classes and<br />

will ensure they will continue to be<br />

drawn to the area.”<br />

Interview<br />

Solutions by the People, for the People<br />

How is Barcelona approaching<br />

IoT?<br />

Barcelona is transforming itself into<br />

a true smart city. The areas they have<br />

focused on – environmental monitoring,<br />

parking, waste disposal and smart<br />

lighting – provide them with a solid<br />

platform for continuing to develop in<br />

the future. Importantly, they have put<br />

all this in place not for the sake of the<br />

technology but because it provides<br />

solutions for the needs of people.<br />

What are the main challenges?<br />

First – scale. With a project like this,<br />

you only benefit when you cover a<br />

large area. This can pose problems<br />

because of the physical environment<br />

or the ‘not in my backyard’ attitudes.<br />

Barcelona has overcome this by effectively<br />

scaling proven technology from<br />

its Urban Lab out over the wider city.<br />

Any others?<br />

There are issues concerning retrofitting<br />

the urban landscape to handle<br />

new technology. For example, providing<br />

power to the parking place<br />

sensors. There is also security. A parking<br />

app helps cut down on pollution<br />

and congestion but it also marks<br />

where the car and owner will be for<br />

the next few hours, so security is an<br />

issue.<br />

There are some pretty nifty<br />

gadgets installed around here. Is<br />

theft a big problem?<br />

With such innovative products, tampering<br />

happens more often than you<br />

might think. Safeguards have to be<br />

put in place to protect the devices.<br />

What’s the payback?<br />

There are two: cost savings and the<br />

ability to influence behavior. Thanks<br />

to IoT, Barcelona has reduced congestion<br />

and lowered car emissions,<br />

water and energy costs. It has also<br />

brought significant economic development.<br />

The quality of life for<br />

residents, workers and visitors has<br />

Thanks to IoT,<br />

Barcelona<br />

has reduced<br />

congestion and<br />

lowered car<br />

emissions,<br />

water and<br />

energy costs.<br />

Giulio Spinelli<br />

EMEA <strong>Smart</strong> City<br />

Business Development<br />

Manager and technology<br />

specialist for timing and<br />

sensing at Avnet Silica,<br />

lives and works in Milan<br />

also improved. Also, collecting data<br />

can help government agencies place<br />

infrastructure where it’s needed in a<br />

far more focused manner. When that<br />

data is also made available to the<br />

public in effective formats, it can encourage<br />

behavioral changes. People<br />

can see it is far quicker to take a bike<br />

than a car for a short trip, or to leave<br />

a trip until later when the pollution<br />

will not be as bad.<br />

source ©: Facebook<br />

65


<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />

IoT and Fighting Forest Fires<br />

Internet of<br />

Trees<br />

66


An hour can make all the difference. In an hour you can weed the<br />

garden, mow the lawn, plant a tree. In that same hour,<br />

as gardeners who make compost may know to their cost,<br />

a smouldering pile of biomass can easily burst into flames.<br />

When this happens in a forest, it can start a fire that<br />

ravages thousands of square kilometres and costs hundreds<br />

of millions of dollars to control.<br />

n By Mark McCoy<br />

Being able to discover forest<br />

fires early is an increasingly<br />

urgent issue. According<br />

to Cal Fire, California’s<br />

firefighting agency, nine of California’s<br />

20 largest fires to date<br />

have occurred since 2020. California’s<br />

Dixie fire, which began in<br />

mid-July 2021, grew to consume<br />

almost 4,000 square kilometres of<br />

forest by the end of September.<br />

According to the New York Times,<br />

authorities spent more than $610<br />

million over those three months<br />

to bring it under control. There<br />

have been similarly extreme fires<br />

over the past five years in places<br />

as far afield as Australia, Greece,<br />

and Portugal. And it’s a growing<br />

issue: the map below shows just<br />

how much of the planet’s surface<br />

Fires are a<br />

growing Issue<br />

A map of global<br />

vulnerability<br />

to wildfires.<br />

is now extremely vulnerable to<br />

wildfires.<br />

The ability to find and suppress<br />

forest fires before they take hold is<br />

therefore of immense value, but it’s<br />

a hard problem to solve given how<br />

large forests can be, the lack of infrastructure<br />

within them, and the<br />

challenge of sensing the earliest<br />

stages of a fire before it bursts into<br />

flames. A Berlin-based startup has<br />

decided to be up for the challenge<br />

and is addressing it by developing<br />

advanced sensing nodes and highly<br />

distributed networking technology.<br />

Although Dryad’s initial focus<br />

is to detect fires, it expects that its<br />

system will also be able to monitor<br />

other aspects of forestry, such<br />

as soil moisture, tree growth, sap<br />

flow, and even illegal logging.<br />

source ©: Dryad Networks<br />

67


<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />

The same technology should also<br />

enable air and water quality monitoring<br />

over large areas.<br />

A Network of Networks<br />

Dryad’s Silvanet is made up of five<br />

major components: three pieces<br />

of hardware, a proprietary RF networking<br />

technology that extends<br />

the reach of the LoRaWAN protocol,<br />

and a cloud analytics and<br />

alerting platform. The whole system<br />

has been designed to overcome<br />

the overarching constraints<br />

of the lack of power and connectivity<br />

in forests.<br />

Dryad’s Silvanet<br />

Wildfire Sensor<br />

is designed to<br />

operate for up<br />

to 15 years from<br />

onboard solar<br />

cells.<br />

source ©: Cision<br />

The Silvanet Wildfire<br />

Sensor<br />

The sensing node for Silvanet is a<br />

solar-powered device that uses a<br />

sensor to measure temperature,<br />

humidity, and air pressure, as well<br />

as the concentrations of gases including<br />

hydrogen, carbon monoxide,<br />

carbon dioxide and volatile<br />

organic compounds at sensitivities<br />

of parts per million. A lowpower<br />

microcontroller, which integrates<br />

support for the LoRaWAN<br />

protocol, runs algorithms based<br />

on machine-learning (ML) strategies<br />

to process sensor data to reduce<br />

the energy burden of communicating<br />

it in raw form over the<br />

LoRaWAN RF network.<br />

The Wildfire Sensor is designed<br />

to run for up to 15 years without<br />

maintenance or a battery, which<br />

avoids introducing potentially<br />

flammable materials such as lithium<br />

into the forest.<br />

Silvanet is<br />

de signed to overcome<br />

the constraints<br />

of the lack<br />

of power and connectivity<br />

in forests.<br />

Carsten Brinkschulte<br />

Dryad Networks<br />

The Silvanet Mesh Gateway<br />

The Silvanet Mesh Gateway uses<br />

a LoRa concentrator chipset to<br />

implement the low-power, low<br />

data-rate LoRaWAN protocol,<br />

which is used to communicate<br />

with the Silvanet Wildfire Sensors<br />

and with third-party sensors that<br />

properly implement the standard.<br />

LoRaWANs usually have a star architecture,<br />

in which each end-node<br />

device, such as the Wildfire Sensor,<br />

has a direct relationship with the<br />

LoRaWAN gateway and through<br />

it to the internet. Although this<br />

approach is simple and widely<br />

implemented, it limits the reach<br />

of LoRaWAN networks to a circle<br />

whose radius is defined by the RF<br />

range from node to gateway. This,<br />

in turn, limits how far a LoRaWAN<br />

network can reach into a forest and<br />

hence its utility for early fire detection<br />

over large areas.<br />

Dryad’s key innovation is to extend<br />

the LoRaWAN with proprietary<br />

technology that links the<br />

gateways to each other to form<br />

a mesh of star networks, which<br />

together can reach much more<br />

deeply into a forest. The Silvanet<br />

Mesh Gateways are also solarpowered<br />

and designed to be<br />

mounted on trees at about three<br />

metres above the ground.<br />

Carsten Brinkschulte, CEO of Dryad,<br />

said: “The mesh is the magic<br />

of what we're doing. Standard<br />

LoRaWAN has a star network architecture<br />

so you can buy dozens<br />

of LoRa gateways, but they<br />

all have one problem. They all<br />

need to be connected directly<br />

to the internet. We place a mesh<br />

gateway every three kilometres<br />

which extends the coverage of<br />

the LoRaWAN network deep into<br />

the forest. Then we have a pro-<br />

source ©: Dryad Networks<br />

68


prietary protocol to connect from<br />

mesh gateway to mesh gateway.”<br />

The Silvanet Border<br />

Gateway<br />

Silvanet WildFire Sensors and Silvanet<br />

Mesh Gateways together<br />

can create an extensive ‘Internet<br />

of Trees’ among themselves, but<br />

they need a Silvanet Border Gateway<br />

to reach the wider internet.<br />

The Silvanet Border Gateway is designed<br />

to be placed at the edge of<br />

the forest, perhaps in a visitor’s car<br />

park or nearby building, to link the<br />

mesh network to the wider internet<br />

and then on to the Silvanet Cloud<br />

Platform. Each Border Gateway can<br />

act as a LoRa gateway, using the<br />

LoRa concentrator chipset. It can<br />

also implement 4G connectivity<br />

using the LTE-M standard and fall<br />

back to 2G and GPRS protocols if<br />

necessary. For even more remote<br />

deployments, the Silvanet Border<br />

Gateway can connect to the internet<br />

using the SWARM satellite network.<br />

The Border Gateway can be powered<br />

by solar cells, if necessary,<br />

although there is also support for<br />

wired power and Ethernet connectivity<br />

if that is available at the<br />

border site.<br />

The Silvanet Cloud Platform<br />

The sensor nodes, mesh networks<br />

and gateways are designed to<br />

bring pre-processed data from<br />

throughout the forest to the<br />

Silvanet Cloud Platform, which<br />

provides a complete solution for<br />

wildfire detection and monitoring<br />

the health and growth of the<br />

forest. The Silvanet application<br />

groups sensor devices and gateways<br />

either by geographical area,<br />

or by characteristics. Details related<br />

to each sensor, especially their<br />

fire status, are shown on a map.<br />

source ©: Dryad Networks<br />

The Silvanet Mesh<br />

Gateway<br />

connects multiple<br />

LoRa star networks<br />

into a daisy-chain<br />

with greater reach.<br />

The Engineering Challenge<br />

Dryad has an experienced team<br />

of founders with a wide variety of<br />

relevant skills but implementing<br />

Silvanet is still a challenge. Along<br />

with the hardware, it includes firmware<br />

development for energy-constrained<br />

data analytics, support for<br />

over-the-air updates, IoT security,<br />

implementing the LoRaWAN and<br />

ensuring standards compliance,<br />

creating the proprietary links between<br />

Mesh Gateways, integrating<br />

multiple forms of RF connectivity<br />

in the Border Gateways, and the<br />

cloud platform and analytics. All<br />

this must be achieved in equipment<br />

working at low power, with<br />

solar panels that are often in shade,<br />

in the difficult RF environment of a<br />

forest, and with the ruggedness to<br />

ensure long operating lifetimes.<br />

And, especially for the Wildfire Sensors,<br />

it must be done at the lowest<br />

possible cost to enable wide deployment.<br />

Brinkschulte says: “If you want to<br />

put something else on the list, RF<br />

communications in the forest is<br />

challenging because every tree is<br />

an obstruction full of water that<br />

absorbs radio waves.”<br />

There are other challenges with<br />

the RF implementation. Both<br />

69


<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />

the LoRaWAN and the 4G radios<br />

in the Border Gateways must be<br />

on all the time because they must<br />

be ready to accept data from the<br />

Wildfire nodes or inbound messages<br />

from the cloud. If 4G LTE-M<br />

connectivity is unavailable, falling<br />

back to 2G protocols also boosts<br />

power consumption.<br />

“A key challenge for us is the ultralow<br />

power design of the sensor<br />

Whispering Forests<br />

The Silvanet Border<br />

Gateway brokers<br />

communication<br />

between the mesh of<br />

LoRa networks and<br />

the internet.<br />

hardware,” says Brinkschulte. “We<br />

need to work in an environment<br />

where we have very little energy<br />

input, yet we have to do something<br />

complex. We need to scan for gas<br />

compositions and run ML software,<br />

it needs to work reliably, and we<br />

need to detect fires very quickly.<br />

These are contradicting goals, and<br />

so one challenge is to select the<br />

right ultra-low power components.<br />

“At the same time, price is key<br />

because we will need to put hundreds<br />

of thousands if not millions<br />

of Wildfire Sensors in a forest for<br />

the system to work, and the price<br />

of each component at that scale<br />

determines the system cost. We<br />

can’t choose a component that<br />

performs extremely well but<br />

pushes the Bill of Material up by<br />

five euro and kills the product.”<br />

source ©: Dryad Networks<br />

Partnering for<br />

Market Insights<br />

Dryad has worked with Avnet<br />

Silica to explore its options for<br />

components that can meet these<br />

tough challenges.<br />

For example, the initial design<br />

uses a single- and dual-core microcontroller<br />

which offers ultra-low<br />

power operation and integrates<br />

LoRa radio, while having the performance<br />

to analyse sensor data<br />

with enough sophistication to detect<br />

wildfires early, without creating<br />

false positives.<br />

“We have to do that in the sensor<br />

because we do not have enough<br />

bandwidth to transmit all of the<br />

sensor data to the analytics in the<br />

cloud,” according to Brinkschulte.<br />

“We really appreciate the competent<br />

discussions we're having<br />

with Avnet Silica. They are bringing<br />

a lot of ideas and proposals for<br />

components which may optimise<br />

the performance of the system.”<br />

Dryad is already looking at potential<br />

optimisations of the hardware<br />

designs with even lower power<br />

and even lower costs, “and that's<br />

a constant discussion that we're<br />

having on which chipsets to use.<br />

We need to have it at really low<br />

cost and ultra-low power because<br />

if you halve the power consumption<br />

of the device you can halve<br />

the size of the solar panel and<br />

energy storage, which are key<br />

price-driving factors of the sensor<br />

node”, Brinkschulte notes.<br />

Dryad is using super-capacitors to<br />

store energy from the solar cells,<br />

rather than introducing potentially<br />

toxic and flammable rechargeable<br />

batteries into the forest.<br />

70


The network architecture of Silvanet<br />

source ©: Dryad Networks<br />

“If you can reduce power consumption<br />

you can reduce the<br />

capacity of the super-capacitors,<br />

which would also drive down the<br />

price. Super-capacitors are not yet<br />

commoditised, and so selecting<br />

the right components is definitely<br />

something where Avnet Silica has<br />

the competency to advise us on selecting<br />

which may perform better,<br />

have better availability, or a better<br />

price.”<br />

Dryad’s use of the parts is also a<br />

little unconventional in that supercapacitors<br />

are more widely used<br />

to provide enough energy to enable<br />

systems that have suddenly<br />

lost mains power to do an orderly<br />

shutdown.<br />

“There's lots of specific things that<br />

we need to do to charge the super-capacitors<br />

from the solar cell,<br />

so we need charging circuits that<br />

actually do that and that is a bit<br />

more challenging because it's not<br />

the standard way of doing things,”<br />

Brinkschulte adds.<br />

Avnet Silica is also helping Dryad<br />

understand current supply constraints<br />

for various parts, caused<br />

by supply-chain issues ranging<br />

source ©: Avnet Silica<br />

from the pandemic through to<br />

factory fires. It has been trying to<br />

ensure that Dryad chooses components<br />

that will be available in<br />

enough volume to allow it to roll<br />

out Wildfire Sensors and Gateways<br />

in volume.<br />

“When you move to your go-tomarket<br />

strategy and try to roll<br />

out your network and the quantity<br />

goes up, you need to have the<br />

microcontrollers and other parts<br />

delivered on time,” says Ingo Seehagen,<br />

senior field application engineer<br />

at Avnet Silica.<br />

From Tree<br />

to Tree<br />

The network<br />

architecture of<br />

Silvanet<br />

When you roll<br />

out your network,<br />

you need<br />

to have your<br />

parts delivered<br />

on time.<br />

Ingo Seehagen<br />

Senior field application<br />

engineer at Avnet Silica<br />

Dryad’s Vision<br />

According to Brinkschulte, wildfire<br />

sensing is just the first application<br />

of the Dryad networking technology.<br />

“This is a generic IoT communications<br />

infrastructure for the forest.<br />

There are tons of applications that<br />

forestry can benefit from once our<br />

infrastructure is in place. Soil moisture<br />

is one of them, tree growth,<br />

sap flow, anti-logging alerts using<br />

sound detection, and emergency<br />

communication for forest workers.”<br />

Forestry equipment maker Stihl is<br />

one of Dryad’s backers. “We create<br />

an IoT network infrastructure that<br />

digitises the forestry industry, and<br />

I guess that's of strategic interest<br />

to them,” says Brinkschulte.<br />

The deal also gives Dryad access to<br />

Stihl’s electronics manufacturing<br />

services, and all the tacit knowledge<br />

and expertise it has in making<br />

rugged electronics for use in<br />

challenging environments.<br />

“That is an advantage for us because<br />

if the mothership uses them,<br />

and the baby uses it as well, that<br />

means they give us good attention.”<br />

71


<strong>Smart</strong> Lifestyle Mobile Services<br />

72


Mobile Services<br />

Taking 5G<br />

to the Max<br />

The pandemic has increased business and<br />

user reliance on mobile services and paved the way for 5G.<br />

But why is it still so difficult to predict<br />

how useful 5G will be?<br />

n By Tom Leddo*<br />

The return on<br />

investment<br />

of 5G for the<br />

operators is<br />

by no means<br />

certain.<br />

Timotheus Höttges<br />

CEO of Deutsche Telekom<br />

<strong>Smart</strong> cities, self-driving vehicles<br />

and advanced robotics<br />

are just the tip of the iceberg:<br />

there's no doubt that<br />

5G will radically change the world.<br />

As far back as 2017, Timotheus<br />

Höttges, the CEO of Deutsche<br />

Telekom, gave an estimate for a<br />

nationwide 5G network in Europe,<br />

saying that the costs could amount<br />

to €300 billion to €500 billion - for<br />

a product whose "return on investment"<br />

for the operators was by no<br />

means certain. Which responsible<br />

businessman would invest such<br />

sums without knowing if and how<br />

such an investment might pay off?<br />

The world is a different place<br />

today than it was before the<br />

COVID-19 lockdowns. Our dependence<br />

on wireless services<br />

has increased dramatically, as has<br />

the demand for more speed and<br />

bandwidth. It would be negligent<br />

to believe that mobile data<br />

traffic will decrease again as the<br />

vaccines roll out and the world<br />

returns to "normalcy." Slow networks<br />

have simply become unacceptable.<br />

All operators are working<br />

flat out to provide users with<br />

better, faster networks. In many<br />

ways, the pandemic has been the<br />

catalyst to accelerate 5G infrastructure<br />

and deployment.<br />

Short-term Impact<br />

Because it is an application-based<br />

technology, we won't know the<br />

full benefits of 5G until it is<br />

source ©: Deutsche Telekom AG<br />

*Tom Leddo is Chief Strategy Officer of MD7, a mobile infrastructure solutions company based in San Diego. 73


<strong>Smart</strong> Lifestyle Mobile Services<br />

7.6<br />

The 5G Readiness Index 2021: Europe is Falling behind<br />

6.1<br />

5.8 5.6 5.6 5.3 5.1 5.0 5.0 4.9 4.7 4.7 4.6<br />

4.3 4.1 4.0 4.0 3.9 3.7<br />

source ©: Deutsche Telekom source ©: Kearney analysis<br />

United States<br />

South Korea<br />

Norway<br />

Japan<br />

Singapore<br />

Switzerland<br />

Beamforming<br />

New aktive antenna technology brings better reception and higher data rates<br />

Passive antenna<br />

Active antenna<br />

Reception evenin<br />

outlying areas<br />

thanks to adjusted<br />

beam signal.<br />

Signals radiate<br />

evenly in all<br />

directions<br />

Signal weaker at<br />

the edge<br />

Individually<br />

controllable signals<br />

can be targeted<br />

Signal is just as strong in<br />

the peripheral area as in the center<br />

Client only uses<br />

telephone, requiring<br />

less bandwidth<br />

Finland<br />

Italy<br />

Unready in Europe<br />

The 5G Readiness Index<br />

reveals that Europe is<br />

falling behind. But 5G<br />

isn't just an upgrade, but<br />

a paragym shift that will<br />

unleash innovation and<br />

new business ideas leaving<br />

latecomers playing<br />

catch-up.<br />

Adjustable<br />

transmitting<br />

power<br />

Perfect coverage <br />

for every single customer<br />

(maximum cell throughput)<br />

China<br />

Netherlands<br />

Sweden<br />

Australia<br />

Denmark<br />

France<br />

tions will not disappear when<br />

the next generation of mobile is<br />

implemented. Rather, they will experience<br />

a performance boost under<br />

5G, such as faster downloads,<br />

improved streaming and gaming,<br />

or more reliable video conferencing.<br />

Mobile operators which can<br />

take advantage of this difference<br />

Horizontal and vertical<br />

antennaadjustment increases<br />

coverageespecially in urban areas<br />

withhighrise buildings.<br />

Signal is only<br />

transmitted<br />

when needed<br />

Client streams video<br />

at high data rates.<br />

Signal is adjusted as<br />

necessary<br />

Germany<br />

Spain<br />

United Kingdom<br />

Austria<br />

Belgium<br />

"here," which will take another<br />

five to ten years. Until then, we<br />

see two types of near-term impact:<br />

How existing applications<br />

work on 5G networks and how 5G<br />

impacts the economy even as it is<br />

being deployed.<br />

Even though 5G is applicationbased,<br />

today's mobile applicawill<br />

definitely be among the winners<br />

of the development.<br />

The other angle from which to<br />

look at the short-term impact of<br />

5G, is the benefit to the economy.<br />

According to a study conducted<br />

for the U.S. by the Boston Consulting<br />

Group, 5G will contribute<br />

between $400 billion and $500<br />

billion to the gross domestic<br />

product there and create up to<br />

one million new jobs by 2030.<br />

Even if these figures already seem<br />

impressive: The economic impact<br />

of a new mobile network has already<br />

been underestimated at<br />

least once. Studies at the beginning<br />

of 4G deployment, for example,<br />

assumed that investment<br />

in 4G networks in the U.S. would<br />

contribute about $73 billion to<br />

$151 billion to GDP from 2012<br />

to 2016 and create 371,000 to<br />

771,000 new jobs. By 2016, however,<br />

4G contributed nearly $445<br />

To Beam or not to Beam?<br />

Instead of emitting a mobile<br />

signal in a circular pattern,<br />

which then becomes weaker<br />

and weaker at the edges, as<br />

has been the case in the past,<br />

beamforming allows 5G signals<br />

to be targeted in the form of<br />

elongated lobes. This means<br />

that the transmission power can<br />

be adjusted as needed.<br />

74


The 5G Economy<br />

will go through three phases,<br />

says the Boston Consulting<br />

Group. Robust 5G networks<br />

will serve as the backbone<br />

of future economic growth.<br />

Rising 5G penetration rates<br />

will enable transformation in<br />

existing applications. Phase<br />

three will bring benefits to<br />

citizens and businesses<br />

including higher productivity,<br />

lower costs, and better health<br />

and safety.<br />

Broad<br />

benefits<br />

5G -enabled<br />

use cases<br />

5G will be the Foundation for Tomorrow's Economy<br />

A robust 5G network will bring significant direct benefits:<br />

• More data, more devices, and increased speed<br />

• A better network experience for US citizens and businesses<br />

source ©: Boston Consulting Group<br />

billion to GDP. Over the course<br />

of the "4G decade," more than 20<br />

million jobs were created in the<br />

U.S. alone.<br />

In this sense, the true impact of<br />

5G is likely to be much higher<br />

than we are currently outlining.<br />

A Look at the Potential<br />

While the near-term impact of 5G is<br />

quantifiable in terms of application<br />

performance and GDP growth, it<br />

still does not take into account the<br />

broader effect of the 5G ecosystem.<br />

For 5G to truly take hold, the<br />

industry must demonstrate the<br />

technology's "business case." Why<br />

else would investment continue to<br />

flow into the sector? How to develop<br />

use cases for 5G without using<br />

5G? It's the ultimate chicken-andegg<br />

scenario. So which comes first,<br />

the technology or the application?<br />

With 4G, it was the technology.<br />

Application versus network was<br />

never an issue with 4G because<br />

4G was content-driven. Consumers<br />

wanted faster speeds to<br />

stream movies, go online and<br />

generally use mobile Internet.<br />

However, while 4G was a big step<br />

Fixed Wireless<br />

Access<br />

Leveraging the improved speed and<br />

performance of 5G to offer broadband<br />

to homes and businesses<br />

Robust<br />

5G network<br />

The Different Rationales for Deploying 5G<br />

Enhanced<br />

Mobile<br />

Broadband<br />

Offering a better and more unique<br />

user experience-often including<br />

tailored content and services<br />

Near term<br />

forward for the way mobile users<br />

consume content, the technology<br />

didn't break through until<br />

the emergence of certain applications.<br />

Through them, developers<br />

learned what the technology<br />

could do and products and services<br />

emerged, such as Uber, that<br />

used 4G to transmit data and locations<br />

- and changed our lives.<br />

With 5G, it's very different. Unlike<br />

4G, 5G lacks a fundamental network<br />

for developers to even begin<br />

developing applications. That's<br />

because we don't yet know what<br />

5G can really do. We also don't<br />

know how applications will use<br />

the near-zero latency and IoT capabilities.<br />

As a result, it's impossible<br />

to assess the true impact of 5G.<br />

Network Cost<br />

Optimization<br />

Meeting network traffic demands in<br />

a more cost-effective manner than<br />

building new cell sites<br />

The business case depends on multiple factors, including market needs, technology options, the existing<br />

(and expected) competitive landscape, marketing strategies, and tailored content<br />

Who Will Lead in 5G?<br />

By the end of the 2G era,<br />

spectrum-related regulations<br />

increased licensing<br />

costs and delayed investment<br />

in 3G in Europe, so<br />

Japan dominated and<br />

was well-positioned to<br />

lead the 4G economy,<br />

too. During both the 2G<br />

and 3G eras, the US was<br />

slow to roll out networks.<br />

However, US regulators<br />

made important policy<br />

decisions, and by 2015,<br />

over 50 percent of adults<br />

in both the US and Japan<br />

had 4G subscriptions—a<br />

higher percentage than in<br />

most European countries.<br />

It remains to be seen who<br />

will lead the 5G revolution.<br />

New Use Cases<br />

Moving beyond core connectivity with<br />

newusecases(verticalor horizontal)<br />

and business models (mostly B2B and<br />

B2B2C)<br />

Long term<br />

5G-enabled use cases are key to building the 5G economy:<br />

• Extreme mobile broadband<br />

• Fixed wireless access<br />

• Massive loT (consumer wearables, logistics and tracking)<br />

• Mission-critical loT (e-health, connected vehicles)<br />

Broad societal benefits will include:<br />

• Improved productivity<br />

• Improved cost competitiveness for US companies<br />

• Improved health and safety<br />

The theoretical possibilities are<br />

endless. At its core, 5G is about real-time<br />

connectivity and connecting<br />

everything to everything – the<br />

basic promise of IoT, after all.<br />

Once the first business model is<br />

established that leverages the capabilities<br />

of 5G, the ROI will likely<br />

be greater than anyone is predicting<br />

today. Just as Uber created a<br />

ride-sharing market that would<br />

have been impossible without 4G,<br />

companies that listen wisely to<br />

their customers can find the next<br />

big niche with the help of 5G.<br />

The Next Big Thing<br />

Each new generation of technology<br />

has brought improvements<br />

with faster and more reliable connections.<br />

Since the introduction of<br />

4G/LTE, mobile has changed the<br />

way people work, live, get around,<br />

or spend their leisure time. But<br />

where those advances were already<br />

astronomical, 5G will far<br />

eclipse them. No one can predict<br />

what the future will bring, but the<br />

limitless potential of 5G is beyond<br />

question. All that remains to be<br />

seen is how, when, and by whom<br />

this technology's enormous potential<br />

will be fully realised.<br />

source ©: Boston Consulting Group<br />

75


<strong>Smart</strong> Lifestyle Interview: Chetan Khona<br />

I bet these last few months have<br />

been an exciting time to work for<br />

Xilinx.<br />

Yeah, Tim, it sure is. Recently,<br />

we’ve doubled down on our<br />

products geared for my segment<br />

of the market: industrial vision,<br />

healthcare and sciences. And, if<br />

you haven't noticed, we've announced<br />

about five years’ worth<br />

of products for industrial and<br />

healthcare IoT edge applications<br />

in the past few months.<br />

Interview<br />

The World<br />

is Shrinking<br />

Computer chips are more powerful and versatile than ever<br />

and they're getting smaller every day. A company making<br />

this happen is Xilinx, based in San Jose, California,<br />

and it is one from just a handful of innovators shaping<br />

the future of semiconductors. The inventor of the field<br />

programmable gate array (FPGA) has just been acquired<br />

by microprocessor giant AMD for the staggering sum<br />

of $35 billion. <strong>Smart</strong> <strong>Industry</strong> sat down with<br />

Chetan Khona, Director, Industrial, Vision,<br />

Healthcare & Sciences at AMD.<br />

n By Tim Cole *<br />

source ©: TIM Global Media BV<br />

So, you already have your work cut<br />

out for you for the next five years.<br />

Yes, absolutely. We just announced<br />

our cost-optimised portfolio<br />

at 16 nanometers, our Artix<br />

UltraScale+ in our extensions towards<br />

Zynq UltraScale+ devices<br />

that are amazingly popular in industrial<br />

healthcare IoT systems. In<br />

April of this year, we introduced<br />

our Kria system-on-modules that<br />

enable developers to programme<br />

and differentiate their designs at<br />

the software level, without requiring<br />

FPGA programming experience.<br />

Then, in June of this year,<br />

we announced our Versal AI edge<br />

products for people who don't<br />

really know what FPGAs are. It’s<br />

an Adaptive Compute Acceleration<br />

Platform (ACAP) for real-time<br />

systems in automated driving,<br />

predictive factory and healthcare<br />

systems, multi-mission payloads<br />

in aerospace and defense, and a<br />

breadth of other applications.<br />

Could you explain what role they<br />

play in the development of IoT systems?<br />

Sure, adaptive system-on-a-chip,<br />

or SoC FPGA for short, is what our<br />

Zynq and Zynq UltraScale+, and<br />

now our Versal AI edge devices<br />

offer: processing at the IoT edge,<br />

right at the analog digital boundary.<br />

They enable scalability from<br />

low to mid to high-end systems<br />

but also allow you to keep running<br />

software on a consistent<br />

Arm processing subsystem. In addition,<br />

they have customised acceleration<br />

blocks for a variety of<br />

76<br />

*Tim Cole is editor of <strong>Smart</strong> <strong>Industry</strong>.


applications ranging from things<br />

like electric drive to patient monitors<br />

and security cameras, all with<br />

the same device. We call this ‘platform<br />

design’ and platforms are<br />

critical to industrial and healthcare<br />

IoT design.<br />

What is FPGA DNA?<br />

When we say FPGA DNA, we are<br />

referring to the fact that, even<br />

though we have systems-onchips,<br />

what separates ours from<br />

traditional SoCs supplied by other<br />

semiconductor manufacturers<br />

is that, in addition the usual set<br />

of status-quo features, we also<br />

offer fabric FPGAs to go along<br />

with them. In the past, you’ve often<br />

seen a processor sitting next<br />

to an FPGA, now you essentially<br />

are getting the functions of both<br />

devices in one because we've<br />

brought the FPGA and the processor<br />

together under one hood.<br />

You mentioned platforms. Why are<br />

they critical in situations like this?<br />

Xilinx has identified a few key<br />

pieces that are used in virtually all<br />

industrial and healthcare IoT systems;<br />

things like functional safety,<br />

cybersecurity, connectivity, control,<br />

vision, mixed criticality, embedded<br />

software and edge AI. These are<br />

pieces that are used in almost all<br />

new industrial and healthcare IoT<br />

designs. If you have to start designing<br />

from scratch every time, you<br />

might have a product out by the<br />

end of the decade, so good luck to<br />

you! But the platform concept helps<br />

you to be more efficient by re-using<br />

blocks and leveraging your investment.<br />

When you mix the scalability<br />

of Xilinx SoCs with this platform in<br />

concept, you get what a lot of our<br />

customers would feel is a winning<br />

combination.<br />

The semiconductor world is moving<br />

quickly to things like miniaturisation,<br />

lower power, lightweight<br />

or even entirely wireless. What can<br />

Xilinx bring to the table here?<br />

You're so right! I mean, no one out<br />

there is selling products that are<br />

bigger, slower or require more<br />

power. The world in all aspects of<br />

life is moving to smaller, lighter,<br />

wireless and battery power. In the<br />

short term, there is this concept<br />

of compute density that we're<br />

really focused on. As more and<br />

more processing is moving to<br />

the extreme edge, to the analog/<br />

digital boundary, compute density<br />

increasingly becomes a bigger<br />

deal. That's something we've<br />

tapped into with InFO packaging<br />

in the cost-optimised portfolio<br />

extensions that we have just announced.<br />

Tell us something about integrated<br />

fan out. What is it and why should<br />

customers be interested?<br />

I wouldn’t recommend your readers<br />

try this at home but if you<br />

were to crack open your mobile<br />

phone – and maybe you have<br />

one, you know, with a fruit logo<br />

on it – you'll see examples of InFO<br />

packaging in action. Integrated<br />

fan out eliminates the substrate<br />

that acts as the interconnect between<br />

the dye and the balls that<br />

connect up to the printed circuit<br />

board. What this means is that<br />

you're getting the most compute<br />

density per square millimetre of<br />

any embedded processor on the<br />

planet without reducing IO count.<br />

Typically speaking, you're going<br />

to see 60 percent smaller size, 70<br />

percent lower height, with zero<br />

IO loss. Having that kind of computational<br />

horsepower in something<br />

smaller than the size of your<br />

fingernail is an absolute game<br />

changer for many industries.<br />

You know, that sounds like the end<br />

of the road for chip miniaturisation,<br />

doesn’t it? How can you possibly<br />

get any smaller?<br />

Well, this is independent from the<br />

natural scaling that takes place,<br />

right? Even though Moore's Law<br />

has slowed down slightly over<br />

time, that doesn't mean that geometries<br />

aren’t still shrinking.<br />

Right now, our 16 nanometer<br />

products are probably main-<br />

Just because<br />

Moore's Law<br />

has slowed<br />

down slightly<br />

doesn't mean<br />

geometries<br />

aren't still<br />

shrinking.<br />

Chetan Khona<br />

AMD<br />

stream for many applications, but<br />

we've announced products, many<br />

of which are already entering into<br />

full-ramp production, that work<br />

at seven nanometers, and the<br />

world is shrinking even more.<br />

If the dye shrinks even further,<br />

the InFO packaging will have to<br />

shrink along with it.<br />

You were personally involved in<br />

the Xilinx solution approach. What<br />

is your primary focus and what are<br />

your core vertical markets?<br />

At Xilinx, we have eight markets<br />

that we’re really focused on,<br />

namely wired and wireless communication,<br />

data centres, automotive,<br />

aerospace and defense,<br />

test and measurement, audiovideo<br />

broadcast, consumer<br />

electronics, and then my market<br />

which is industrial vision, healthcare<br />

and sciences which makes<br />

up almost 40 percent of the total<br />

number of customers Xilinx has<br />

out there.<br />

You are partnering with Avnet<br />

Silica, the sponsors of this magazine<br />

and the corresponding podcast,<br />

We Talk IoT, in which you’ve<br />

already appeared. What is Avnet’s<br />

role in your go-to-market process?<br />

As we touched on when you<br />

asked about the ecosystem, we're<br />

fortunate to have partners, and in<br />

this case Avnet Silica, as a close<br />

cooperative partner with whom<br />

we can generate clear value for<br />

customers on a daily basis. They<br />

do the distribution and financial<br />

services, support and upfront<br />

architectural advisement for customers’<br />

design services, from the<br />

chip to the board to connectivity<br />

to the cloud. They do the training<br />

and events that draw a lot<br />

of people, whether in person or,<br />

these days especially, online but<br />

most importantly for us, they're a<br />

trusted partner that our customers<br />

think of first and can count<br />

on even in such uncertain times.<br />

I would say they are the key player<br />

in my own business go-to-market<br />

process.<br />

77


<strong>Smart</strong> Solution Data Marketplaces<br />

Data Marketplaces<br />

Old Data for<br />

Sale<br />

Do you know what your data is worth? Many private<br />

companies and public sector organisations could be sitting on<br />

piles of money they could use for other purposes– but where can<br />

they go to buy, sell or exchange this ‘used’ data? Data exchanges<br />

are an exciting new frontier in the realm of Big Data.<br />

n By Stian Overdahl<br />

78


Data exchanges, or data<br />

marketplaces, could potentially<br />

unlock new revenue<br />

streams for companies,<br />

as well as lowering the cost of engaging<br />

in data-intensive activities,<br />

such as training machine-learning<br />

algorithms. Aside from exchanges,<br />

white label solutions for large corporates<br />

and their suppliers are another<br />

promising development.<br />

Any company can estimate the<br />

value of its data by calculating the<br />

cost of collecting it, its value to an<br />

internal commercial project, and<br />

its quality and longevity (will it<br />

have value in five years’ time?). In<br />

the era of data exchanges, these<br />

figures take on a new cogency<br />

as companies sell data sets, give<br />

them to trusted partners or acquire<br />

new data sets.<br />

Establishing a value for data on a<br />

public marketplace could bring<br />

big benefits to companies. For<br />

example, a project generating a<br />

significant amount of data could<br />

defray some of its costs by selling<br />

it, while a project where collection<br />

costs are significant could be done<br />

more cheaply by buying-in data.<br />

Sheridan Johns, head of ecosystem<br />

at Ocean Protocol, a blockchain-based<br />

data exchange, says,<br />

“People understand that data is<br />

valuable, and people are building<br />

valuable companies using data,<br />

but what are people going to<br />

pay for data? Putting data on our<br />

marketplace, allowing data to be<br />

Data<br />

Provider<br />

Compute<br />

Provider<br />

of digital and emerging technology<br />

at professional services firm EY.<br />

Buyers of raw data often find that<br />

suppliers collect and aggregate<br />

data in different ways and formats.<br />

A company that wants to<br />

provide a weather service, for example,<br />

can run into difficulties as<br />

it must obtain data from various<br />

measuring sites.<br />

It’s likely that a weather station<br />

run by a professional organisation,<br />

like an airport, would collect<br />

data more frequently, whereas<br />

others, such as a community organisation,<br />

would sample less frequently.<br />

In addition, the various<br />

measurers may calibrate their sensors<br />

differently. Maintenance can<br />

also be a factor – for example, one<br />

supplier may experience more<br />

downtime or it may decide to<br />

upgrade its software, making the<br />

data fragmented or unreadable.<br />

There are also questions about<br />

whether a company can build a<br />

product with a competitive advantage<br />

by relying on third-party data<br />

sources, or does it need to build its<br />

own sensing infrastructure?<br />

“In 99 percent of cases, you will<br />

recognise that the competipriced<br />

in real time using dynamic<br />

pricing features and automatic<br />

market makers, enables an individual<br />

or organisation to publish<br />

a certain dataset and determine<br />

exactly what its value is.”<br />

Johns believes that within ten<br />

years it’s going to be commonplace<br />

for large organisations to be<br />

either buyers or sellers of data using<br />

online data marketplaces. This<br />

potential growth will result from<br />

the growing need for data, especially<br />

for artificial intelligence.<br />

Increased demand and a growing<br />

awareness of the importance of<br />

data also makes companies more<br />

likely to share externally, notes Didier<br />

Navez, senior vice president of<br />

strategy and alliances at Dawex, a<br />

data exchange. “In the context of<br />

training AI, it seems like the market<br />

is evolving and maturing, and<br />

companies are really willing to<br />

share data. Clearly data exchanges<br />

help in that process because they<br />

provide a structured environment<br />

where exchange of data is secure<br />

and compliant,” he says.<br />

There are still several flies in the<br />

ointment, especially in the domain<br />

of IoT: quality of data, privacy<br />

and commercial sensitivities.<br />

"When it comes to monetisation<br />

of IoT data, people think it should<br />

be easy. Unfortunately, there are<br />

a couple of huge issues and this<br />

concept very quickly becomes<br />

very complicated,” says Aleksander<br />

Poniewierski, global head<br />

Decentralized Data Market Protocol and Network of AI Data / Servies<br />

Storage<br />

Provider<br />

Analytics<br />

People understand<br />

that data<br />

is valuable, but<br />

what are they<br />

going to pay?<br />

Sheridan Johns<br />

Ocean Protocol<br />

Further<br />

Processing<br />

source ©: New Work SE<br />

source ©: Asia Crypto Today<br />

Algorithm<br />

f(x)<br />

Curation<br />

Building a Data Ecosystem<br />

Through the help of decentralised service<br />

agreements and access controls powered<br />

by virtual machines, Ocean allows users<br />

to access, monetise, and even curate data<br />

management services that they will need<br />

for their businesses.<br />

79


<strong>Smart</strong> Solution Data Marketplaces<br />

tive advantage comes from building<br />

your own data infrastructure,<br />

rather than sourcing [externally],”<br />

says Poniewierski. If a company<br />

creates a business that relies on<br />

external data sources, then competitors<br />

might easily surpass it, he<br />

notes.<br />

Putting Data to Good Use<br />

Exchange operators embrace a<br />

range of different models, ranging<br />

from fully open data marketplaces,<br />

through restricted marketplaces<br />

or corporate internal data sharing<br />

platforms, to data brokers that will<br />

search for a data set on request.<br />

There is also the split between private<br />

and public sectors. For example,<br />

several public sector organisations<br />

have a mandate to share data<br />

sets and a marketplace is one way<br />

to make these more readily available.<br />

One such project, Gaia-X in<br />

Europe, envisages a marketplace<br />

to improve artificial intelligence<br />

product development, including a<br />

“protected data room for development<br />

and test data in order to continuously<br />

improve the AI applications<br />

and adapt them to customer<br />

needs”.<br />

Long-running fears about personal<br />

data privacy means there is now<br />

the potential for forming decentralised<br />

autonomous organisations<br />

80<br />

The advantage<br />

comes from<br />

building your<br />

own data infrastructure.<br />

Aleksander Poniewierski<br />

Global head of digital<br />

and emerging technology<br />

at EY<br />

Purchasing Platform<br />

<strong>Smart</strong> Contracts by<br />

Databroker DAO is a<br />

platform for listing,<br />

verifying, aggregating,<br />

enhancing and<br />

reselling data through<br />

a simple and intuitive<br />

user interface.<br />

(DAOs) where individuals could<br />

share their own anonymised data<br />

with others.<br />

“What we’re seeing emerging on<br />

the consumer front is the idea of<br />

data unions, or data DAOs, where<br />

individuals are encouraged to pool<br />

their data into one larger data set.<br />

Then, when that data set is used<br />

by the third party, the rewards are<br />

distributed to all of the individuals<br />

who helped to make it,” says Johns.<br />

source ©:EY / Ernst & Young Global Limited<br />

White-label solutions target organisations<br />

where commercial sensitivity,<br />

privacy and other concerns<br />

are top of mind. These allow data<br />

sets to be shared securely between<br />

business units within the organisation<br />

or with trusted supply-chain<br />

partners.<br />

In the enterprise segment, the advantages<br />

of sharing data may outweigh<br />

commercial sensitivities. In<br />

the German automotive industry,<br />

companies – including Mercedes-<br />

Benz, BMW and Volkswagen – are<br />

exploring the potential benefits<br />

of a data exchange programme.<br />

The goal is an open, scalable network<br />

for sharing cross-company,<br />

standardised information. As a<br />

technology partner, Ocean Protocol<br />

describes the basic concept as<br />

showing how competitive companies<br />

can benefit mutually by sharing<br />

data rather than building separate,<br />

proprietary, siloed services for<br />

themselves.<br />

Financial opportunities will depend<br />

on the value companies<br />

see in the data they obtain on exchanges,<br />

and what they’re willing<br />

to spend. In turn, that depends on<br />

how the data can improve business<br />

outcomes – and its quality.<br />

source ©: Medium


Interview<br />

Circular Reasoning<br />

What is Dawex?<br />

Dawex helps facilitate the circulation<br />

of data among various stakeholders.<br />

We are developing data<br />

exchange platforms that can be<br />

used by many different types of<br />

organisations, whether private or<br />

public.<br />

Why are data exchanges important?<br />

As you know, the world is seeing<br />

an explosion in data being created.<br />

IoT is part of the reason but,<br />

even though the supply of data is<br />

incredibly high – activities such<br />

as training a machine learning algorithm<br />

requires huge amounts<br />

of data – demand is increasing a<br />

lot, more than a single organisation<br />

can typically supply. Organisations<br />

need to look to external<br />

sources. Of course, you have open<br />

data, you can scrape the web and<br />

do things like that but very often<br />

the most important data are residing<br />

at other organisations – accessing<br />

that can be challenging,<br />

at least legally.<br />

So that’s where data exchanges<br />

come in?<br />

They connect the data suppliers<br />

with the data acquirers and help<br />

them engage. That requires trust.<br />

Elements that can create trust<br />

include being able to carry out a<br />

data transaction in a secure and<br />

regulatory compliant environment<br />

– something you can typically<br />

embed in a data exchange<br />

platform.<br />

Can I buy used data like I buy a<br />

used car? Does it belong to me?<br />

Data owners must consider<br />

whether they are ready to make<br />

their data available to others and,<br />

if so, on which terms and conditions,<br />

and at what price. Typically,<br />

data is licensed. Instead of buying<br />

the data outright, the buyer<br />

purchases a license which allow<br />

them to use it under certain<br />

terms and conditions. There are<br />

also many regulations governing<br />

data sales – not just private data,<br />

but any kind of data. We know of<br />

more than 120 pieces of regulation<br />

globally and our anticipation<br />

is that the data economy is going<br />

to be regulated as heavily as the<br />

financial markets – if not more so.<br />

What are the technical requirements?<br />

The actual sharing and transferring<br />

of data can happen in many<br />

ways: simple, file-based exchange<br />

or API-based; it can be a one-time<br />

transaction versus subscription<br />

or ongoing. With a subscription<br />

the user obtains access to data<br />

Data owners<br />

must always<br />

know who they<br />

are dealing<br />

with, who is<br />

using the data,<br />

and how it will<br />

be used.<br />

Didier Navez<br />

Dawex<br />

source ©: Dawex Systems<br />

for a certain period, with the data<br />

updated on a regular basis according<br />

to the agreement. The<br />

challenge and opportunity for<br />

the data exchange provider is to<br />

be able to keep track of, and cope<br />

with, all these use cases and scenarios.<br />

At Dawex, we manage all<br />

these issues, whether it’s a hedge<br />

fund making a one-off acquisition<br />

of a data set to test an algorithm,<br />

or on-going projects, for example<br />

in the agricultural sector and in<br />

the agri-foods industry.<br />

In September 2021, you joined<br />

a consortium of partners from<br />

the aerospace industry to create<br />

what you call the Space Data<br />

Marketplace. What is the rationale<br />

behind that?<br />

This project is focused on satellite<br />

data. Currently, the domain<br />

is quite siloed. There are multiple<br />

sources where you can get<br />

these data now but it’s neither<br />

very streamlined nor efficient. We<br />

want to create a one-stop shop<br />

for all types of satellite data for<br />

all kinds of use cases and initiatives.<br />

For example, we have companies<br />

developing solutions for<br />

analysing infrastructure using AI<br />

or looking at applications such<br />

as rail or waterways or managing<br />

crops and vegetation.<br />

What’s the difference between<br />

open exchanges and closed<br />

white-label ecosystems, and<br />

how do you see this playing out?<br />

A modern data exchange environment<br />

should push for transparency,<br />

so the data owner will always<br />

know who they are dealing with,<br />

who is using the data and how<br />

it will be used. That’s a very important<br />

principle for augmenting<br />

the trust that corporates have for<br />

making their own data available<br />

to others and, for example, avoiding<br />

the chance that a competitor<br />

would be able to access sensitive<br />

data they shouldn’t have.<br />

81


<strong>Smart</strong> Solution Machine Vision<br />

Machine Vision<br />

How to See<br />

the World<br />

Machines aren’t just becoming smarter every day –<br />

they are also developing the ability to see the world around them.<br />

In fact, artificial eyes can penetrate to greater depths and<br />

pick out much more detail than our weaker human eyes can<br />

ever hope to see. And yes, they can see in the dark, too.<br />

For IoT applications, this could be a real eye-opener.<br />

n By John Koon<br />

82


Light detection and ranging<br />

(Lidar) is a remote sensing<br />

method that uses pulsed laser<br />

light to measure ranges<br />

(variable distances). Similar to its<br />

close cousins, radar using radio<br />

waves and sonar emitting sound<br />

waves under water, Lidar uses laser<br />

light to accurately measure ranges<br />

(distances) – something that is critical<br />

for many sectors and industrial<br />

processes.<br />

Theoretically, measurement can be<br />

performed using other technologies,<br />

but Lidar has multiple advantages<br />

over them. For example, it has<br />

a higher resolution than radar and<br />

a wider range than camera sensors<br />

and can even perform in the dark.<br />

Furthermore, Lidar produces 3D<br />

data and can detect and differentiate<br />

objects. As a result, it can be used<br />

to track objects, detect physical protrusions<br />

and survey landscapes.<br />

Measuring carbon dioxide, sulfur<br />

dioxide and methane in the air or<br />

water can also be achieved with<br />

Lidar, making it ideal for things like<br />

geographical surveys, autonomous<br />

driving, industrial applications and<br />

logistics.<br />

source ©: NOAA<br />

The Face of the Earth<br />

Geographical surveys are not just<br />

for mapping mineral and water<br />

resources, they have been used to<br />

map zones prone to earthquakes,<br />

tsunamis, landslides, flooding and<br />

volcanic activity to deal with potential<br />

disasters. In addition, coastlines<br />

need to be surveyed for effective<br />

management and planning for<br />

navigational, environmental and<br />

homeland security purposes.<br />

As global warming raises sea levels<br />

and causes extreme weather events<br />

like enormous floods and droughts,<br />

high-resolution geographical surveys<br />

will be crucial for monitoring<br />

the effects of global warming, such<br />

as coastline erosion. This information<br />

can help governments to devise<br />

coping strategies, such as safe<br />

and responsible land use and emergency<br />

preparedness, to protect civilian<br />

lives and marine wildlife.<br />

The National Oceanic and Atmospheric<br />

Administration (NOAA), an<br />

agency primarily responsible for<br />

mapping US shorelines, sought to<br />

increase the efficiency and reduce<br />

the subjectivity of older technologies,<br />

such as tide coordinated aerial<br />

photography. Data collection in intertidal<br />

zones was also poor because<br />

these areas are too shallow for<br />

survey vessels to approach safely.<br />

NOAA now uses airplanes and helicopters<br />

equipped with two types of<br />

Lidar: topographic and bathymetric.<br />

Topographic Lidar typically uses a<br />

near-infrared laser to map the land,<br />

while bathymetric Lidar uses waterpenetrating<br />

green light to measure<br />

seafloor and riverbed elevations.<br />

Lidar is helping<br />

us understand<br />

sea-level rises<br />

and coastal<br />

flooding/inundation<br />

impacts,<br />

and marine life<br />

habitat mapping.<br />

Stephen White<br />

NOAA<br />

National Ocean Service<br />

Monitoring<br />

the Warming<br />

A view looking northeast<br />

from Virginia Key<br />

shows the topobathymetric<br />

surface of the<br />

intertidal zone near<br />

Fisher Island. This<br />

image was created<br />

from the LiDAR bare<br />

earth model colored<br />

by elevation.<br />

The two images can be combined to<br />

produce a single ‘topobathymetric’<br />

image of the coastal area.<br />

Driving Force<br />

How do we make sure autonomous<br />

cars and trucks pay proper attention<br />

and avoid disasters in near<br />

darkness, pouring rain, heavy snow<br />

or on a winding road?<br />

Lidar’s high speed and accuracy enable<br />

distant object detection on a<br />

moving vehicle, even in low light.<br />

This makes it a powerful technology<br />

for advanced driver-assistance<br />

systems (ADAS) in drones and vehicles.<br />

It performs less well in heavy<br />

rain and snow or in fog but work is<br />

in progress to find ways to improve<br />

its reliability in all but the worst conditions.<br />

Earlier Lidar technologies were<br />

typically used in applications with<br />

a high tolerance for failure. In contrast,<br />

the bar is much higher for<br />

safety, accuracy, and reliability<br />

when using it in autonomous vehicles.<br />

Products need to be designed<br />

from scratch to meet the 3D sensing<br />

requirements of automotive active<br />

safety systems, ADAS implementations<br />

and autonomous vehicles. In<br />

addition, solutions must be small<br />

and unobtrusive which is a challenge<br />

for Lidar.<br />

83<br />

source ©: NOAA


<strong>Smart</strong> Solution Machine Vision<br />

Aerial Mapping<br />

YellowScan uses<br />

a mix of dronemounted<br />

passive<br />

and active laser<br />

sensors to create<br />

3D maps for mining,<br />

civil engineering,<br />

forestry, environmental<br />

research,<br />

and archeology.<br />

Passive Sensor<br />

Active Sensor<br />

source ©: MicroVision<br />

source ©: YellowScan<br />

The scan rates and angles of the<br />

sensor need to be dynamically controlled<br />

and limiting the number of<br />

sensors used helps to decrease overall<br />

cost. It also minimises the amount<br />

of high-resolution data that must be<br />

collected and analysed on an often<br />

fast-moving and sporadically accelerating<br />

and decelerating vehicle.<br />

Vehicles need to<br />

see further out<br />

and understand<br />

more about<br />

what they see,<br />

such as which<br />

objects are<br />

moving and<br />

where are they<br />

heading.<br />

Jari Honkanen<br />

MicroVision<br />

The latest high-resolution 3D systems,<br />

such as MicroVision’s Long<br />

Range Automotive Lidar, meet stringent<br />

3D sensing requirements. They<br />

are compact and non-intrusive,<br />

with fast frame rates and can characterise<br />

an environment more accurately<br />

with a higher level of information<br />

analysis. These features enable<br />

vehicles to respond more rapidly to<br />

obstacles and avoid them.<br />

Making Things Work<br />

Industrial applications for Lidar include<br />

things like manufacturing<br />

and robotics automation. Systems,<br />

such as Baraja’s Spectrum-Scan, are<br />

being deployed in mining vehicles<br />

to map locations and visualise environments.<br />

It can also help improve<br />

worker safety in mines and caves.<br />

Mines are often located in remote<br />

areas and underground, where<br />

pockets of lethal gases tend to accumulate.<br />

Methane is explosive, carbon<br />

dioxide and carbon monoxide<br />

are lethal to humans at high concentrations,<br />

and hydrogen sulfide<br />

is poisonous and highly flammable.<br />

Therefore, using laser light to detect<br />

gas pockets allows miners to deal<br />

with them promptly, keeping them<br />

safe and making their time in the<br />

mine more efficient.<br />

Just as Lidars image the 3D topography<br />

of the environment for<br />

autonomous vehicles, they can be<br />

used above ground to detect unwanted<br />

gas concentrations during<br />

gas mapping. For example, a methane<br />

leak can be detected by pointing<br />

a laser beam of a specific color<br />

Loggerhead Lighthouse<br />

This image is a topobathymetric<br />

point cloud colorised<br />

by intensity. This image was<br />

captured during a survey of<br />

the Dry Tortugas, and is the<br />

lighthouse on Loggerhead Key.<br />

source ©: NOAA<br />

84


An Eye on the Road<br />

source ©: Bridger Photonics<br />

Scientists have approached the challenges<br />

of determining range, angleand<br />

velocity in two ways: using radio waves<br />

and using laser light. Lidar, radar and<br />

sonar each have their benefits and<br />

deficiencies in autonomous vehicles.<br />

Google’s spin-off company Waymo and<br />

Aurora, which took over Uber’s ill-fated<br />

project, both use Lidar but have radar<br />

for support in foggy, rainy or snowy<br />

conditions to assist Lidar’s less-reliable<br />

results in extreme weather. Tesla uses<br />

ultrasonic sonar to map the environment<br />

and a front-facing radar.<br />

A Sentry in the Sky<br />

At least 2 percent of gas<br />

resources is wasted through<br />

leaks of methane. A drone-based<br />

laser-based Remote Methane<br />

Leak Detector (RMLD) by Physical<br />

Sciences might solve the problem.<br />

at the suspected location or along<br />

a survey line. Some of the laser<br />

light is absorbed by the target gas<br />

and the rest bounces back as a diffused<br />

beam. The Lidar receives the<br />

reflected beam, measures the light<br />

absorption and calculates the density<br />

of the leaking methane.<br />

This process generates geo-specific<br />

images of gas plumes that can be<br />

combined with satellite and other<br />

data to create a map illustrating the<br />

leak’s extent and location. The GPS<br />

coordinates of the map can quickly<br />

direct a maintenance crew to the<br />

leak. So far, ExxonMobil and SoCal-<br />

Gas have used Lidar gas-mapping<br />

technology to detect leaks.<br />

source ©: Baraja<br />

What Will the Future Bring?<br />

In all cases, high-definition cameras<br />

supplement and complement the<br />

other systems to add visual context.<br />

The color cameras also provide the<br />

ability to monitor traffic lights and<br />

read road signs, which is beyond<br />

the other three sensors. This is useful<br />

where emergency signs have<br />

been put out by emergency services<br />

or for roadworks that may not be<br />

mapped on satnav systems.<br />

Lidar sensors are being developed<br />

that are even more miniaturised<br />

and lighter so they can be used for<br />

unmanned aerial systems, such as<br />

drones performing geographical<br />

surveys. Meanwhile, reducing costs,<br />

increasing reliability and enhancing<br />

data resolution will be common<br />

goals for the next generation.<br />

We are also likely to see further democratisation<br />

of Lidar applications.<br />

For example, the low-performance<br />

3D Lidars appearing in smartphones<br />

are likely to be replaced by<br />

ones with higher resolution and<br />

processing. In short, Lidar will be<br />

more compact, more capable and<br />

lower cost.<br />

Lidar systems<br />

can accurately<br />

map and visualise<br />

surrounding<br />

hazardous environments<br />

increasing<br />

safety<br />

and efficiency.<br />

Jim Kane<br />

Baraja Industries<br />

■ Radar<br />

Radio detection and ranging, coupled<br />

with hi-res cameras, is an approved way<br />

for providing machines with ‘sight’. In<br />

1886, German physicist Heinrich Hertz<br />

demonstrated that radio waves are reflected<br />

by metallic objects. British scientists,<br />

spurred on by the militarization of<br />

Germany, used this property to develop<br />

radio-based detection and ranging in<br />

1935. Independently, Germany, the USA<br />

and Russia also developed radar systems<br />

in the following year or two. These<br />

systems were all designed to detect<br />

huge hunks of metal at sea or in the air<br />

and in the years since then refinements<br />

have been made to finesse the detection<br />

capabilities to include all manner of<br />

objects, including humans.<br />

■ Lidar<br />

In 1960 the invention of laser technology<br />

created a flurry of research<br />

activity to find uses for the powerful<br />

light beams. In 1961, a US scientist<br />

named Malcom Stitch, who worked<br />

for the Hughes Aircraft Corporation,<br />

introduced the first functional Lidar<br />

system but it wasn’t until the arrival of a<br />

commercially available global positioning<br />

system (GPS) using satellites and<br />

inertial measurement units (IMUs) in<br />

the late 1980s that accurate positional<br />

data became available.Lidar’s reach is<br />

constantly increasing. Currently, Aeva,<br />

based in Silicon Valley, is selling its 4D<br />

Lidar system on-a-chip which has a<br />

range of 500m.<br />

85


Column Bernd Schöne<br />

Liquid Software<br />

Wetware Revisited<br />

There was a time when ‘wetware’ was a<br />

geek word for the part of the body<br />

that computer scientists use to<br />

gather and modify their thoughts.<br />

But jargon moves on and the new<br />

buzzword is ‘liquid software’, which<br />

stands for a system that can be updated<br />

and modified at any time without<br />

interrupting its flow. So, it isn’t all that<br />

different from wetware, is it?<br />

Agreeing on a definition for the new<br />

buzzword, on the other hand, is tricky. If<br />

you ask me, it simply represents a cautious<br />

step forward, albeit in the right general direction,<br />

with many more to follow.<br />

Software for IoT has very specific requirements. The<br />

market is fast-moving, unit volumes are high, and<br />

prices are manageable. The need to transfer large<br />

amounts of data across device and network boundaries<br />

is essential – as is the distribution of updates.<br />

Without software that is up-to-date, seamless interaction<br />

between sensors (acquiring data), data centres<br />

(crunching data), decision-makers (evaluating<br />

data) and actuators (controlling data) is impossible<br />

– and, without it, so is IoT. It comes as no surprise that<br />

the concept of ‘liquid’ has caused quite a flurry since<br />

its introduction to IT in 2014, even though, or maybe<br />

because, no one can say precisely what it is.<br />

The water analogy helps us understand what it is<br />

everybody’s talking about – and why they’re so excited.<br />

Just as water will always find its way to a river<br />

Dams and dikes<br />

are barriers<br />

that keep water –<br />

and data – from<br />

flowing freely.<br />

Bernd Schöne<br />

is a veteran German Internet<br />

journalist and an expert on<br />

cybersecurity<br />

and the sea, data and applications should be<br />

able to flow steadily and independently to<br />

where they are needed throughout the<br />

IoT network. The latest software versions<br />

running individual IoT components<br />

should autonomously go with<br />

the flow, with error corrections and<br />

new features being automatically<br />

patched-in on the way.<br />

This is not a new concept. The internet<br />

itself, and the World Wide Web, have<br />

been connecting computer systems for<br />

years, and ‘patch days’ are as old as the<br />

first servers. Before now, automatic updates<br />

were always instigated by specific applications,<br />

such as a browser or an email programme.<br />

Everything else required actions by the user. That's<br />

about to change. In the future, streams of data, applications<br />

and updates will find their own way to<br />

their destinations without a single click of a mouse.<br />

So far so good but experience has taught us that<br />

where liquid flows are concerned, dikes and weirs<br />

are essential to the successful co-existence of water<br />

and people. No one knows this better than the<br />

inhabitants of Europe, who were hit by horrendous<br />

flooding in 2021. The Dutch know better than most<br />

how to handle water: After a devastating storm<br />

surge in 1953, they sealed off the entire country from<br />

the North Sea within 30 years.<br />

Weirs and dikes are barriers that keep water – and<br />

data – from flowing freely and out of control. In IT,<br />

86


malware and substandard sets of data play the role<br />

of storm surges and floods. They must be contained.<br />

Even today, there are already such barriers in place in<br />

many companies but these ‘dikes’ are usually there<br />

for economic reasons. Apple and Google, both pioneers<br />

of the liquid software idea, with products like<br />

Apple's Handoff (Continuity) service and Android’s<br />

Lollipop, are fighting doggedly for market share –<br />

but the days of data monopolies are over.<br />

Keeping your users locked up within the walls of<br />

your own company network is the direct opposite<br />

of liquid software. It takes away the key advantages<br />

for the user and puts the whole idea of liquidity in<br />

danger.<br />

In my opinion, IoT dams and weirs should not be<br />

built by stock market analysts and CEOs, but by CTOs.<br />

There should be a coherent technical need for barriers<br />

to minimise security issues. Sandboxing of unknown<br />

data is one way to minimise risks but clear requirements<br />

for structure and security checks for incoming<br />

updates and new applications would also help.<br />

Technically, this is no longer a problem for machine<br />

tools whose AI intelligence always assumes a defect<br />

is imminent, based on conspicuous fluctuations in<br />

measured parameters. These predictive systems can<br />

not only inform service departments, without being<br />

told to do so, but can also automatically determine<br />

the availability of spare parts and the maintenance<br />

personnel waiting in the background. Edge systems<br />

can then autonomously calculate the team’s arrival<br />

time and determine when things will be running<br />

smoothly once again. All this without the maintenance<br />

or security teams needing to pick up the<br />

phone or for an employee to send an email to alert<br />

them.<br />

The IT support world is full of data: information about<br />

traffic flow, the number of service vehicles on standby,<br />

the location and condition of necessary spare or<br />

replacement parts. All we need to do is unlock this<br />

treasure trove of information and let the data flow.<br />

When that happens, we’ll be amazed to find what opportunities<br />

we’ve been missing just because phone<br />

providers, internet service providers, equipment<br />

manufacturers and operators, service companies,<br />

and application distributors have been jealously<br />

protecting their sinecures instead of networking in a<br />

purposeful way.<br />

Today, service technicians have to identify themselves<br />

to the gatekeeper, even though their IDs may<br />

have been established long ago and the exact time<br />

of their visits would already have been noted in all<br />

the company's IT systems. Unfortunately, gatekeepers<br />

don’t know any of this. Too bad!<br />

Of course, nobody should jump blindly into the flow.<br />

As always, prudence and precautions are necessary.<br />

New management tools, like ‘scrum’ software which<br />

helps teams to learn from shared experiences, will<br />

make IT security easier to achieve – there’s still no<br />

substitute for the human brain if we want to take IoT<br />

to the next level. In the end, it means that someone<br />

has to accept responsibility for any system. But as for<br />

the software? Just let it flow.<br />

87


<strong>Smart</strong> Solutions <strong>Smart</strong> Sensors<br />

<strong>Smart</strong> Sensors<br />

<strong>Smart</strong> Eyes for IoT<br />

Technicians have been reluctant to<br />

use cameras for IoT because they were<br />

considered too expensive. That is now<br />

history. Today, CMOS sensors with<br />

respectable resolution cost only a<br />

few dollars and chips that deliver<br />

high-definition images are available<br />

for a little more. Thanks to AI, new<br />

integrated image signal processors<br />

(ISPs) are taking the strain off transmission<br />

networks and edge computing.<br />

88<br />

n By Bernd Schöne<br />

Cameras provide lots of data<br />

and the more data, the better<br />

they are. Unfortunately,<br />

that clogs up the communications<br />

channels. In addition, the<br />

images have to be prepared and<br />

processed which puts a strain on the<br />

computers in the system. Often, the<br />

normal TV frame rate of around 25<br />

frames per second is not enough, either.<br />

Manufacturing machines operate<br />

so fast that surveillance cameras<br />

have to deliver 60 or more images<br />

per second. Thanks to data reduction,<br />

the H.265 transmission format<br />

shrinks the amount of data and thus<br />

enables wireless operation – but<br />

H.265 is computationally expensive,<br />

which is a shortcoming for batterypowered<br />

devices.<br />

CMOS chips also have peculiarities.<br />

Most sensors produce a certain<br />

basic noise level, even in absolute<br />

darkness. These chips also inevitably<br />

contain a few defective pixels.<br />

No problem – there are correction<br />

programmes for that. In addition,<br />

the distances between camera and<br />

object are often small in IoT applications.<br />

Also, no problem – that's what<br />

wide-angle lenses are for, though<br />

they do tend to distort and suffer<br />

from vignette shadowing around<br />

the edges.<br />

If the image analysis determines<br />

whether labels on a bottle are correctly<br />

positioned, for example, image<br />

errors can confuse and deceive<br />

the analysis programme. Here, too,<br />

there are proven remedies. However,<br />

correction programmes put a<br />

strain on the camera CPUs because<br />

the correction is best done before<br />

the image has been compressed in<br />

order to achieve optimum results.<br />

This, in turn, puts further strain on<br />

the communications channels.<br />

Usually, in cheaper systems, the<br />

black-and-white image of the sensor<br />

has to be transformed into a color<br />

image. For this purpose, the mosaiclike<br />

pattern of color filters over the


Qoitech<br />

Fighting Power Hunger<br />

source ©: Qoitech AB, Elektor Verlag GmbH<br />

camera sensor has to be back-calculated,<br />

so to speak, in order to obtain<br />

red/green/blue color separations<br />

(demosaicing). This also costs computing<br />

power.<br />

A new generation of image signal<br />

processors (ISPs) now offers developers<br />

a solution to these problems.<br />

ISPs operate in the immediate vicinity<br />

of the camera module and handle<br />

all the pre-processing of the images.<br />

They are calibrated to the chip and<br />

its optics and transform the raw data<br />

into images that can be easily processed<br />

further.<br />

In reality, no one is interested in<br />

the camera images, only the results<br />

count – thumbs up or thumbs<br />

down. In the labeling example, the<br />

operator wants to know if the label<br />

is positioned correctly: is it crooked<br />

or, in the case of pharmaceuticals, is<br />

it stuck together in such a way that<br />

it’s no longer legible? When cleaning<br />

bottles, no one is interested in<br />

the 100,000 bottles that have been<br />

cleaned well but only in those that<br />

need to be cleaned again or belong<br />

in the waste because they have a<br />

crack.<br />

Today, AI can take over these relatively<br />

simple tasks and the new ISPs<br />

also have a neural network on board<br />

that runs an AI programme for image<br />

analysis. In this way, the engineers<br />

can let them make their own<br />

decisions without the need for cloud<br />

support or data flow gymnastics.<br />

Most IoT devices are battery powered but<br />

designers want to know how power consumption<br />

will fare over time. Finnish startup Qoitech<br />

has launched the Otii Arc, an inexpensive ‘little<br />

helper’ that makes it possible to precisely<br />

track current, voltage and power consumption<br />

before a device is deployed.<br />

All batteries react the same way to load – the<br />

voltage output plummets. Unlike a flashlight,<br />

an IoT sensor does not load the battery evenly.<br />

Sometimes the sensor is ‘asleep’ and consumes<br />

no energy, sometimes it sends data and<br />

consumption skyrockets for a short time. Decisive<br />

for the load profile is the software, which<br />

may or may not be cleverly written, and the<br />

environment, especially the temperature. The<br />

Otii Arc measuring device connects directly<br />

to the sensor and a laptop. It acts as a power<br />

Fraunhofer<br />

How to Bee a Sensor<br />

What does a bee need to survive? Dramatically<br />

declining populations spurred the German<br />

government to have special sensors developed.<br />

In response, researchers at Fraunhofer<br />

source ©: Micro-Sensys GmbH<br />

source and determines the load profile over<br />

the operating time until the dreaded ‘brownout’<br />

as the battery empties.<br />

Qoitech’s device allows small development<br />

offices to carry out their own measurements<br />

and tests at a high technical level. The target<br />

groups also include software developers because<br />

the more cleverly the software manages<br />

the energy reserves, the longer the sensor<br />

battery will last. Programmers can now conveniently<br />

and quickly determine the success of<br />

their efforts without having to rely on lab tests<br />

from engineering firms.<br />

Determining battery runtimes is not the easiest<br />

of tasks. Within a few months of the launch,<br />

Qoitech received a number of requests and<br />

suggestions from users, which it rapidly incorporated<br />

in a software update.<br />

IZM created ultralight wireless sensors that can<br />

be attached to a bee's back, turning the insect<br />

into a flying IoT sensor. The RFID chip transmits<br />

important flight data as well as temperature<br />

and brightness to a base station. The system,<br />

which weighs only ten milligrams, is powered<br />

by a specially developed ultra-light battery<br />

which receives its energy from a microscopic<br />

solar module.<br />

In the medium term, the Sens4Bee project,<br />

based at Fraunhofer’s Helmholtz Centre for<br />

Environmental Research (UFZ) is to become a<br />

tool for all interested beekeepers. The aim is to<br />

clarify the relationship between bee mortality<br />

and the application of pesticides.<br />

89


<strong>Smart</strong> Solutions <strong>Smart</strong> Companies<br />

<strong>Smart</strong><br />

Companies<br />

Robotics Research<br />

Automated Rapid Transit<br />

A growing list of IoT innovations<br />

have been developed and<br />

deployed by companies which<br />

are using IoT to solve real-world<br />

problems in transport. Robotics<br />

Research’s AutoDrive advanced<br />

driver assistant system (ADAS)<br />

is one of these potentially revolutionary<br />

approaches to IoT. It is<br />

‘platform agnostic’ – meaning<br />

that it can be used to retrofit<br />

vehicles of all sizes, from small,<br />

portable robots to large trucks<br />

and buses. The system provides<br />

vehicles with autonomous driving<br />

functionality on surfaces<br />

ranging from urban-improved<br />

roads to off-road terrain, while<br />

also collecting and analysing<br />

data to enhance the driving experience.<br />

Robotic Research has deployed<br />

Society of Automotive Engineers<br />

(SAE) Level-Four automation<br />

where self-driving is supported<br />

only in limited spatial<br />

areas (geofenced) or under special<br />

circumstances. Outside of<br />

these situations, the vehicle will<br />

safely abort the trip by slowing<br />

down and parking the vehicle<br />

if the driver does not retake<br />

control. The AutoDrive technology<br />

is currently operating in 30<br />

states in the US and on four continents.<br />

Recently, the company has<br />

helped the Connecticut Department<br />

of Transportation to make<br />

source ©: New Flyer<br />

Electric Commute<br />

Flyer Xcelsior Charge<br />

heavy-duty transit buses<br />

are operating on the<br />

CTfastrak corridor, a<br />

dedicated nine-mile<br />

(14.5 km) stretch for exclusive<br />

use by CTtransit<br />

buses.<br />

advancements in automated<br />

public transit thanks to a new<br />

programme funded by the US<br />

Department of Transportation.<br />

Through the department’s Integrated<br />

Mobility Innovation (IMI)<br />

initiative, Robotic Research’s<br />

proprietary AutoDrive system<br />

is enabling the automation of<br />

heavy-duty transit buses for<br />

passenger service deployment.<br />

This will be a first for mass<br />

transportation systems in North<br />

America.<br />

Three automated New Flyer<br />

Xcelsior Charge heavy-duty<br />

transit buses are operating on<br />

the CTfastrak corridor, a dedicated<br />

nine-mile (14.5 km) stretch<br />

for exclusive use by CTtransit<br />

buses. The 40-foot, electric buses<br />

will offer a zero-emission operation<br />

running between New<br />

Britain and downtown Hartford,<br />

the capital of Connecticut.<br />

As the first automated Bus Rapid<br />

Transit line put into public service<br />

in North America, the CTtransit<br />

initiative also marks the<br />

first application of automated<br />

precision docking to optimise<br />

platform gaps. This, and other<br />

automated technology to improve<br />

access, ensures boarding<br />

is compliant with the Americans<br />

with Disabilities Act (1990)<br />

which prohibits discrimination<br />

based on disability, while increasing<br />

accessibility for all passengers.<br />

90


source ©: Space&Matter, Isabel Nabuurs Fotografie<br />

Space&Matter<br />

Launching A Floating<br />

Neighbourhood<br />

Climate change may force some<br />

city dwellers to take to the water.<br />

At least, that is the thinking at architects<br />

Space&Matter, founded<br />

in 2009 by Sascha Glasl, Tjeerd<br />

Haccou and Marthijn Pool. United<br />

by the desire to improve the world<br />

for their children and all future<br />

generations, their journey began<br />

with Water voor Wonen (Water for<br />

Living), a floating neighbourhood<br />

in the low-lying Dutch polder region.<br />

"Since urban areas struggle with<br />

high density, we should make better<br />

use of the space on the water,”<br />

says Haccou. Co-founder Glasl<br />

adds, “We want to set the example<br />

and show how living on water can<br />

be a great and better alternative<br />

for people and our planet."<br />

Their signature project, which<br />

began almost a decade ago but<br />

was only completed in the summer<br />

of 2021, is called Schoonschip<br />

– literally ‘clean ship’ in Dutch.<br />

Space&Matter says it was originally<br />

a “circular neighbourhood<br />

which was initiated and developed<br />

by a group of enthusiasts with a<br />

shared dream: to build a sustainable,<br />

close-knit community on the<br />

water”. The group approached the<br />

architecture firm to help design<br />

the urban plan, plotting the boardwalks<br />

and smart jetty that unite<br />

the inspired community.<br />

The project houses more than 100<br />

people in 46 sustainable homes<br />

across 30 water plots. The area<br />

was designed to be mainly selfsufficient,<br />

with a minimal impact<br />

on nature while adapting to the<br />

rising water.<br />

Schoonschip also uses clean<br />

energy sources, using solar<br />

Sascha Glasl<br />

is passionate about strategic<br />

design, innovative<br />

concepts and democratic<br />

development processes<br />

Tjeerd Haccou<br />

likes using online and offline<br />

tools to bring together and<br />

empower communities<br />

Marthijn Pool<br />

is excited about researchbased<br />

projects that explore<br />

new urban concepts<br />

panels and heat pumps to provide<br />

heating, and the architects<br />

plan to convert wastewater<br />

from toilets and showers into<br />

energy. All buildings also have<br />

a green roof – part vegetation<br />

and geared to rainwater collection.<br />

C40 Cities Climate Leadership<br />

Group, a collaboration between<br />

the mayors of 97 cities worldwide,<br />

agree that climate change<br />

may force many to choose to<br />

live on the water. It estimates<br />

that some 800 million people<br />

and 570 cities could be at risk<br />

by 2050 if sea levels rise by half<br />

a metre, as forecasted by some<br />

experts. C40 Cities – which represents<br />

a twelfth of the global<br />

population and a quarter of its<br />

economy – believes that the<br />

floating neighbourhood in Amsterdam,<br />

Netherlands, shows<br />

one way to cope.<br />

“Living on the water offers a<br />

great solution for places where<br />

climate change and a rise in sea<br />

levels are a looming hazard,”<br />

says Glasl. “It not only protects<br />

people against nature, it also<br />

protects nature itself.”<br />

91


<strong>Smart</strong> Lifestyle One More Thing<br />

And now:<br />

One More Thing<br />

For more than a year, the team at <strong>Smart</strong> <strong>Industry</strong>, the IoT Business<br />

Magazine, has been hosting a monthly series of podcasts<br />

called We Talk IoT. These consist of interviews with experts in the<br />

various areas of IoT who have something<br />

really important to say,<br />

n By Tim Cole<br />

92


The podcast covers a wide<br />

range of topics ranging from<br />

IoT infrastructure to autonomous<br />

vehicles, artificial intelligence,<br />

predictive analysis and<br />

cybersecurity. It is sponsored by<br />

Microsoft Azure and features on<br />

Spotify, Apple Podcasts and Sound-<br />

Cloud to reach an average audience<br />

of 5,000 to 6,000 listeners per<br />

month. We encourage our interview<br />

guests to link to the podcast from<br />

their own websites and social media<br />

platforms to boost overall listenership.<br />

If you would like to hear it, you<br />

can find it through our homepage at<br />

www.smart-industry.net/podcast.<br />

Every issue of We Talk IoT concludes<br />

with a short editorial item of interest<br />

which we call One More Thing. As of<br />

now, the editors will get to choose<br />

their favourite installments to share<br />

here at the end of our print edition.<br />

Foresolution<br />

Where’s the Loo? IoT<br />

Flushes It Out<br />

One of the most challenging jobs for<br />

IoT technologies is real-time tracking<br />

of goods and assets at remote locations,<br />

even when they lack a power<br />

source. Portable toilets are a good<br />

example. They’re usually tucked<br />

away well out of sight (and smell)<br />

and sometimes the only way to find<br />

them is to send out a search party.<br />

Foresolutions, a UK technology<br />

company, thinks it’s found a better<br />

way to locate and check the status<br />

of such hard-to-find assets as porta<br />

Mobile Expandable<br />

Wellbeing Unit<br />

Compacting to a 4ft<br />

(1.2 m) cube, the<br />

MEWU fits onto a<br />

standard rail trolley or<br />

trailer anywhere on<br />

track for deployment<br />

at the point of work.<br />

The Daily<br />

Travel Puzzle<br />

At Heathrow, as in<br />

any major airport,<br />

hundreds of companies<br />

work together<br />

to make travel<br />

safe and smooth.<br />

Increasinly, they<br />

rely on IoT to coordinate<br />

thousands of<br />

routine tasks, from<br />

toilete to air traffic<br />

control.<br />

potties, construction tools and airtraffic<br />

equipment, just to name a<br />

few. The company is providing battery-powered<br />

IoT devices along with<br />

its own software for managing nonpowered<br />

items in outdoor working<br />

environments.<br />

These often include seats of ease, euphemistically<br />

called Mobile Expandable<br />

Wellbeing Units, or MEWUs<br />

(pronounced ‘mews’). These are typically<br />

bright orange, interconnecting<br />

boxes placed at railway or building<br />

construction sites. They contain<br />

removable wastewater tanks and<br />

compartments for additional<br />

source ©: Selectequip source ©: Twitter / Heathrow Airport Limited<br />

93


<strong>Smart</strong> Lifestyle One More Thing<br />

source ©: Digital Matter<br />

Live Long and<br />

Prosper!<br />

Ultra-rugged longlife<br />

battery-powered<br />

GPS devices like this<br />

one from Digicore<br />

offer up to seven<br />

years of asset tracking,<br />

theft recovery,<br />

and more.<br />

IoT data<br />

keeps units<br />

sanitised<br />

and wellmaintained.<br />

Tom Ross<br />

Foresolutions<br />

safety equipment such as defibrillators<br />

and first-aid gear. The units cost<br />

lots of money and are mostly left to<br />

fend for themselves out somewhere<br />

in the boondocks.<br />

Thanks to battery-powered sensors<br />

and wireless connectivity, Foresolutions<br />

helps railroads and construction<br />

companies keep track of their<br />

units, tell whether they are being<br />

used and when to call in maintenance.<br />

In addition, the company<br />

has deployed several thousand IoT<br />

devices at Heathrow Airport to keep<br />

track of various non-motorised assets<br />

– tools, steps, tugs and other<br />

equipment – in order to help management<br />

understand their utilisation<br />

and to locate equipment when<br />

needed.<br />

Throughout the past year, Foresolutions<br />

has been partnering with Australia’s<br />

Digital Matter, which makes<br />

battery-powered sensors that leverage<br />

wireless networks – including<br />

LTE, GSM, WiFi and Bluetooth – to<br />

forward data to the cloud, no matter<br />

where the sensor is deployed.<br />

On the mobile toilets, the company<br />

is using Digital Matter's Oyster 2 sensor<br />

devices, powered by three AA<br />

batteries, to update companies with<br />

the information they need to manage<br />

the units.<br />

Traditionally, this type of data cannot<br />

be accessed without a human<br />

visiting the station. Foresolutions'<br />

system can detect not only the GPS<br />

location but also such conditions as<br />

the opening and closing of doors,<br />

vibration, temperature and humidity<br />

changes, as well as water, ice<br />

and other outdoor conditions. Any<br />

changes in location or sensor readings,<br />

such as tilting or moving, are<br />

forwarded to the headquarters so<br />

those in charge of the stations can<br />

tell if they are being moved. After all,<br />

these units cost a lot of money and<br />

theft is not unknown.<br />

IoT data also helps to ensure that the<br />

units are sanitised and well-maintained,<br />

says Tom Ross, Foresolutions'<br />

managing director. He has plans to<br />

expand his solutions beyond mobile<br />

loos, as they’re called in the UK, to<br />

include such markets as farms, factories,<br />

hospitals and shopping centres<br />

or even amusement parks.<br />

source ©: Foresolutions<br />

source ©: Foresolutions<br />

IoT Everywhere<br />

IoT solutions in facility management can<br />

fullfil multipile roles at once, for instance<br />

building & structure monitoring, temperature,<br />

air quality, presence, occupancy,<br />

energy, noise, door opening, weather and<br />

environmental conditions, people tracking,<br />

safe distancing, as well as security & access<br />

control and CCTV.<br />

94


source ©: Marine Science Institute, UC Santa Barbara, Salesforce.com, San Diego State University<br />

SharkEye<br />

AI Drones Track and<br />

Protect Great White Sharks<br />

Academics from the University of<br />

California and San Diego State have<br />

teamed up with AI researchers from<br />

Salesforce to create software that<br />

can spot sharks swimming around<br />

popular beach sites.<br />

SharkEye, as the system is called,<br />

uses drones to spot sharks from<br />

above. The unmanned flying vehicles<br />

follow pre-programmed paths<br />

at a height of around 120 feet (36.5<br />

metres) to cover large areas of the<br />

ocean without disturbing marine<br />

life. The goal of SharkEye is eventually<br />

to produce automated ‘shark reports’<br />

for beachgoers to help them<br />

assess levels of risk.<br />

The researchers hope this application<br />

of AI can help keep beaches<br />

safer, encourage a more informed<br />

public and help people learn how<br />

to share the waves with wildlife. Perhaps,<br />

most importantly, the system<br />

could help protect the gradually improving<br />

populations of great white<br />

sharks, top predators that are a<br />

healthy part of the California ocean<br />

ecosystem, says Doug McCauley, director<br />

of the Benioff Ocean Initiative<br />

and a professor at the University of<br />

California Santa Barbara.<br />

Salesforce AI is using its proprietary<br />

Einstein Vision algorithm – ordinarily<br />

used for visual search, brand<br />

detection and product identification<br />

– to process drone video and<br />

recognise the unique attributes<br />

of sharks, thereby identifying<br />

them without the need for physical<br />

tagging. This information will<br />

then be shared with local officials<br />

and beachside communities, so,<br />

without ever touching the water,<br />

SharkEye can make sure it’s safe for<br />

the rest of us to hop in!<br />

Shark Alarm!<br />

The dashboard created<br />

for the SharkEye project<br />

at Santa Barbara's Parado<br />

Beach is meant to openly<br />

share data insights on<br />

sharks collected from dronebased<br />

arial surveys as well<br />

as acoustic detections. Both<br />

are shown on a current-day<br />

and a seven-day rolling<br />

average.The latter provide<br />

a clearer picture of trends<br />

in abundance compared<br />

to expected variation in<br />

daily peaks and dips in shark<br />

activity. Absence of shark<br />

sightings or acoustic signals<br />

are not an indicator that<br />

no sharks are present - in<br />

California's costal waters,<br />

they almost always are.<br />

The goal here<br />

is to reduce<br />

the number<br />

of traffic<br />

accidents.<br />

Ivan Ndip<br />

Fraunhofer Institute<br />

for Reliability<br />

and Microintegration<br />

(IZM) in Berlin<br />

Fraunhofer<br />

Many Still Wait for 5G –<br />

but 6G is Just<br />

Around the Corner<br />

Most smartphone owners are still<br />

waiting for 5G to appear but the telco<br />

industry is already gearing up for the<br />

next step. The starting pistol for this<br />

next generation of mobile communications,<br />

6G, has already been fired.<br />

"With 6G, we have the ambitious<br />

goal of achieving data rates of terabits<br />

per second and a latency of<br />

about 100 microseconds – that’s 50<br />

times the data rate and one-tenth<br />

the latency of 5G," says Ivan Ndip,<br />

an expert on antennas and radio frequency<br />

systems at the Fraunhofer<br />

Institute for Reliability and Microintegration<br />

(IZM) in Berlin.<br />

Ndip uses autonomous driving to<br />

explain the difference. The goal here,<br />

he says, is to reduce the number of<br />

accidents. 5G has a maximum data<br />

rate of about 20 gigabits per second<br />

– nowhere near enough to communicate<br />

a car’s position to other road<br />

users in real time, much less to measure<br />

distances and scan through 360<br />

degrees at the same time.<br />

The self-driving car needs to be<br />

able to look far into the distance<br />

while also focusing on close-up<br />

things. For this, autonomous vehicles<br />

require sensors that combine<br />

both radar and cameras, and need<br />

to be able to collect enormous<br />

amounts of data and share them<br />

simultaneously. According to Ndip,<br />

Fraunhofer IZM is currently developing<br />

such sensors.<br />

source ©: Fraunhofer Institute for Reliability and Microintegration IZM<br />

95


<strong>Smart</strong> Lifestyle One More Thing<br />

source ©: Khachi<br />

The car must also react instantly to<br />

unforeseen circumstances, so, in addition<br />

to very high data rates, the<br />

sensors must exhibit extremely low<br />

latency. Ndip says, 5G just doesn’t<br />

cut it. He adds that 5G is still missing<br />

a couple of critical components<br />

as well as the network intelligence<br />

necessary to handle true hands-off<br />

autonomous driving.<br />

“That's why we need 6G," the scientist<br />

maintains. Although 6G will not<br />

be operational until at least 2030,<br />

Ndip believes that governments<br />

and telcos need to start investing in<br />

the new technology now.<br />

Hardware still needs to be developed<br />

for mobile communications<br />

above 100 GHz but, for most manufacturers,<br />

this is terra incognita as<br />

they have never worked with frequencies<br />

like these before. Typically,<br />

researchers and developers need a<br />

ten-year head start for this kind of<br />

mammoth project, Ndip says. Setting<br />

the necessary specifications<br />

and standards alone will take at<br />

least five years, he believes.<br />

Fraunhofer recently opened its 6G<br />

Innovation Campus in Cottbus – the<br />

so-called iCampus – where it plans<br />

to do research into new networking<br />

and sensor technologies, together<br />

with the local university and two separate<br />

Leibnitz Institutes. The future of<br />

mobile communications, it seems,<br />

just can’t happen fast enough.<br />

<strong>Smart</strong> Dessous<br />

Myant's new Skiin brand<br />

textiles monitor their<br />

owner's vital functions<br />

and sleeping habits<br />

and can even wake up<br />

sleepy drivers before<br />

they doze off at the<br />

wheel.<br />

Myant<br />

A New ‘Brief’<br />

in Health Monitoring<br />

Underwear is getting a lot smarter<br />

these days. Myant, an innovator in<br />

wearables, has developed a smart<br />

pair of briefs that could potentially<br />

transform healthcare.<br />

Biometric sensors woven into the<br />

fabric of the underwear can measure<br />

things like sleep quality, activity,<br />

stress levels, temperature and<br />

heart condition, to provide some of<br />

the most reliable and effective ways<br />

to detect and prevent health issues,<br />

the company claims.<br />

The Skiin brand fabric sends data<br />

to a corresponding app and onwards<br />

to the cloud platform which<br />

analyses the data to provide guidance<br />

on lifestyle changes and the<br />

information can, with permission,<br />

be shared with healthcare providers.<br />

Underwear is a good choice for<br />

a smart garment because it makes<br />

consistent, close contact with the<br />

body – a must-have for continuous<br />

skin sensors.<br />

Myant’s underwear innovation fits<br />

into the larger trend of e-textiles<br />

and smart clothing, powered by<br />

artificial intelligence and tiny semiconductor<br />

technology. Scientists<br />

are attempting to replace clunky<br />

ECGs and health monitoring devices,<br />

like watches and chest straps,<br />

with comfortable smart garments.<br />

Healthcare providers and developers<br />

believe advances like these will<br />

increase compliance and lead to<br />

better health outcomes.<br />

<strong>Smart</strong> garments will probably be<br />

able to do much more for us. Sensors<br />

can now be embedded directly<br />

into textiles – similar to weaving additional<br />

yarn into an existing piece<br />

of fabric – or by applying sensors<br />

to the top of the fabric. Either way,<br />

the use cases for e-textiles go far beyond<br />

health monitoring. <strong>Smart</strong> garments<br />

can to do things like:<br />

• diagnose comfort levels of amputees<br />

by monitoring their interaction<br />

with their artificial limb.<br />

• assess patterns in athletes’ performances<br />

and deliver small electric<br />

shocks to underperforming<br />

muscles.<br />

• wake up sleepy drivers on the<br />

road before accidents occur, using<br />

built-in fatigue monitoring.<br />

• connect to smart home systems<br />

to do things like changing the<br />

thermostat when your body is<br />

cold (or hot).<br />

The latest report by research firm<br />

IDTechE predicts that smart textiles<br />

will be worth over $1.4 billion by<br />

2030. The number of potential applications<br />

and markets for e-textiles<br />

is vast, including military and space,<br />

automotive, haptic suits for virtual<br />

reality, sports and fitness, and assistive<br />

clothing.<br />

source ©: Skiin<br />

96


Kerlink<br />

Windmills Push Spread of<br />

Public IoT Services<br />

Like many others along the Netherlands<br />

North Sea coast, the Port of<br />

Moerdijk has a large wind farm. The<br />

farm was installed in 2020 and is<br />

operated by Vattenfall, a European<br />

green energy specialist. The wind<br />

farm supplies 27 megawatts of<br />

clean energy to more than 27,000<br />

households.<br />

But officials soon realised the turbine<br />

towers could serve an additional<br />

purpose by hosting an IoT<br />

network to provide key sensor data<br />

to the bustling port 120 metres below.<br />

IoT networking company Kerlink<br />

was commissioned to create the<br />

gateways for the LoRaWAN project.<br />

The Kerlink Wirnet iStation receives<br />

sensor data and information from<br />

within a radius of 25 kilometres and<br />

securely transfers it to users of the<br />

energy-efficient IoT network. This<br />

includes monitoring air quality,<br />

CO2 emissions, water levels and detecting<br />

whether bridges and gates<br />

around the port are open or closed,<br />

source ©: Kerlink<br />

which helps move traffic more efficiently<br />

while reducing emissions.<br />

In addition, the industrial-grade<br />

IoT network will be available at low<br />

cost for organisations near the port<br />

in shipping, rail and other industries<br />

as well as to municipalities,<br />

government agencies and individuals.<br />

Aurélien Seugnet, Kerlink’s business<br />

developer, is happy with the<br />

results so far. “The wind industry<br />

The wind<br />

industry could<br />

be crucial to<br />

builidng the<br />

public Internet<br />

of Things.<br />

<strong>Smart</strong> Station<br />

The Kerlink Wirnet<br />

iStation receives<br />

sensor data and<br />

information from<br />

within a radius of<br />

25 km and can<br />

monitor air quality<br />

in addition.<br />

Aurélien Seugnet<br />

Kerlink<br />

could become a crucial building<br />

block in the public Internet of<br />

Things,” he believes. “We usually<br />

use high buildings and pylons [as<br />

mounting points],” he added – so<br />

why not use turbine towers?<br />

The height of the towers means<br />

the signal is stronger and can reach<br />

further. Besides which, piggybacking<br />

on a wind generator does away<br />

with the constant need to change<br />

batteries.<br />

source ©: CCM Benchmark Group<br />

source ©: Storm<br />

97


Column Gerd Leonhard<br />

The Future<br />

Looks Great!<br />

Are you excited about the future or are<br />

you worried? Are you expecting good<br />

things or more misery? These days, it seems<br />

like all around us, the future is getting bleaker<br />

and bleaker. Netflix and Hollywood are telling us about<br />

dystopian scenarios. The news is showing more reels<br />

of climate change disasters, economic issues, clueless<br />

CEOs and politicians. And of course, in the end, the robots<br />

will take our jobs, and then they're going to harvest<br />

our bodies for energy.<br />

But despite all of that noise, I am here to tell you that the<br />

future is better than we think. I believe that human ingenuity,<br />

our science and technology can and will solve<br />

most of our long-standing problems. I also believe that<br />

human kindness and the ability to collaborate will prevail.<br />

But we're running out of time because the future is<br />

arriving faster than we think. Actually, the future is already<br />

here, we just haven't paid enough attention.<br />

Whether it’s enhancing humans, designing chimeras or<br />

robots going to war: What will happen during the next<br />

ten years will sweep away most of our notions about<br />

gradual progress and upend our views about how technological<br />

innovation usually and maybe even inadvertently<br />

furthers the common good.<br />

In my speeches, I have recently started talking about<br />

what I call “the good future” – a utopia (or better yet,<br />

a protopia) as opposed to a dystopia. As hard as it may<br />

be for all of us to agree on what a “good” future would<br />

look like, we must submit to the hard work of creating<br />

such a definition. Because, if we don’t reach some kind<br />

of consensus, there may be no future at all – at least not<br />

for us humans. One thing we know for certain is that<br />

the Good Future is not likely to come about with good<br />

Gerd Leonhard<br />

is the founder of<br />

The Futures Agency (TFA)<br />

and author<br />

of the bestseller<br />

Technology vs Humanity.<br />

He is based in Zurich<br />

Technology is<br />

morally neutral<br />

until we use it.<br />

William Gibson<br />

old-fashioned “greed capitalism”, and neither<br />

will it be ushered in by technology. Rather, it will<br />

be a question of ethics and values – and the policies<br />

we craft from them.<br />

Now is the time to think about and act on “civilising”<br />

– maybe a better word would be “rehumanising” our<br />

technology. Yes, this will mean regulating (but not<br />

strangulating) the global tech giants, because in this<br />

age of advanced exponential change, today’s amazing<br />

breakthroughs may well turn out to be major problems<br />

not too far down the road.<br />

It’s time to stop asking “what will the future bring” – it<br />

can, quite literally, bring almost anything we can imagine.<br />

Instead, we need to ask: “what kind of future do we<br />

want?<br />

It is a basic truth that technology can serve opposite<br />

purposes, good or bad. And as William Gibson famously<br />

said, it remains morally neutral until we use it.<br />

“Too much of a good thing” describes this conundrum<br />

very well: something quite useful can quickly become<br />

something deeply harmful and corrosive to society –<br />

as recently evidenced with social media, which suffers<br />

from excessive monetisation obsession and utter lack<br />

of accountability.<br />

We are at a fork in the road: The future is our choice,<br />

by action or by inaction. And time is of the essence. We<br />

have at most ten short years to debate, agree on and<br />

implement new, global (or at least territorial) frameworks<br />

and rules as far as governing exponential technologies<br />

are concerned.<br />

Call me an optimist or a utopian, but I am convinced<br />

that we can still define and shape a “good future” for all<br />

of mankind – as well as for our planet.<br />

98


We Talk IoT,<br />

the <strong>Smart</strong> <strong>Industry</strong> Podcast<br />

Welcome to We talk IoT, a regular series of podcasts<br />

from the editors of <strong>Smart</strong> <strong>Industry</strong> – the IoT<br />

Business Magazine. Our podcast keeps you up to<br />

date on the most important developments in the<br />

world of IoT, IIoT, Artificial Intelligence and Cognitive<br />

Computing. Listen to leading industry experts,<br />

business professionals and experienced journalists<br />

as they discuss some of today’s hottest tech topics<br />

and how they can help boost your bottom line.<br />

You can listen to the first episode right here on<br />

smart-industry.net. Or you can follow We talk<br />

IoT, the <strong>Smart</strong> <strong>Industry</strong> podcast on the following<br />

streaming providers to always get the latest<br />

episodes:<br />

Go to Spotify<br />

Go to Apple Music<br />

Go to Soundcloud<br />

This podcast is brought to you by Avnet Silica in<br />

cooperation with Microsoft.<br />

powered by


Let our wide portfolio help<br />

you meet your analog needs<br />

Innovative products for reliable,<br />

accurate, high-efficiency designs<br />

Operational Amplifiers<br />

• High voltage<br />

• Precision and high accuracy<br />

• Dual high bandwidth<br />

Power Operational Amplifiers<br />

• High output current<br />

• Low drop and high gain<br />

Current sense amplifiers<br />

• Uni- and bi-directional<br />

• Integrated, robust, and safe<br />

For more information visit www.st.com/opamp

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!