Smart Industry No.1 2022
Smart Industry No.1 2022 - The IoT Business Magazine - powered by Avnet Silica
Smart Industry No.1 2022 - The IoT Business Magazine - powered by Avnet Silica
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
smart<br />
powered by<br />
industry<br />
The IoT Business Magazine<br />
7.50 EUR No. 01.<strong>2022</strong><br />
THE FUTURE<br />
OF IOT<br />
KEEP ON<br />
TRUCKIN’<br />
Fixing the Logistics<br />
Bottleneck<br />
CURRENT<br />
TRENDS<br />
EV Charging<br />
Means Business<br />
Internet<br />
of Trees<br />
A Better Way<br />
to Fight Forest Fires<br />
The Age of the Digital Human<br />
THE MAN MACHINE
XILINX INNOVATIONS<br />
GET STARTED<br />
WITH YOUR DESIGN<br />
WINNING THE 5G RACE<br />
Wherever 5G drives innovation, from over the air, satellite<br />
to ground, and private network to 4.0 automation, cutting<br />
edge 5G applications require both increased bandwidth,<br />
and fast computing into a lower power and smaller form<br />
factor radio.<br />
The RFSoC product family’s breakthrough integration<br />
translates to lower power, a smaller footprint, and higher<br />
performances. It enables demanding 5G applications such<br />
as multi operators, 400MHz iBW, Multi Carriers, Sub 6GH<br />
and MMwave, whilst supporting ease of use and flexibility<br />
of design evolution.<br />
By enabling a ‘Radio in One chip’ design (from O-RAN interfaces<br />
to RF) with high performance and low power, the Zynq<br />
RFSOC family provides significant benefits for applications<br />
that require fast computing at a lower cost.<br />
avnet-silica.com
Editorial<br />
Creating<br />
the Future<br />
Tim Cole<br />
is editor-in-chief of<br />
<strong>Smart</strong> <strong>Industry</strong> –<br />
the IoT Business Magazine.<br />
<strong>Smart</strong> homes and factories, smart clothing<br />
(so-called “wearables”), autonomous<br />
cars, trucks and drones and other<br />
stuff from the world of science fiction<br />
have become everyday phenomena that introduced<br />
the world to IoT technology and its<br />
giant potential. The continued growth of this<br />
technology and its use has created a global IoT<br />
market of $389 billion, which is forecasted to<br />
reach $1 trillion in 2030 (according to Statista).<br />
IoT allows the physical world to be integrated<br />
into computer-based systems, which, in turn,<br />
helps to improve the efficiency of the systems<br />
and reduces human intervention. So we’ve<br />
come a log way, right?<br />
And it’s everywhere, effecting industries from<br />
transportation (shipment & tracking), retail<br />
(inventory management) hospitality (voice<br />
assistants) to healthcare (health & wellness<br />
monitoring).<br />
Let’s take a closer look at some of them.<br />
In retail, the global market for IoT is expected<br />
to reach $182.04 billion by 2028 according to a<br />
report by Grand View Research. Much of this<br />
growth will be due to advances and reduced<br />
cost for IoT hardware and sensors, etc., but improvements<br />
in customer experience through<br />
much increased customer tracking and personalization<br />
are expected to be the real drivers.<br />
Using beacons, brands or retail stores can<br />
attract passersby to visit their stores by sending<br />
IoT-enabled notifications to their smartphones.<br />
The Internet of Things connecting<br />
everything to everything also means connecting<br />
to everyone.<br />
Supply chain optimization will not only unlock<br />
the bottleneck for stuff that has stifled both retails<br />
waiting for shipments from Asia but manufacturers<br />
of cars and sophisticated electronic<br />
systems desperate for chips. IoT sensors do not<br />
just track location, but also humidity, temperature,<br />
tilt, shock, speed and driving behaviors,<br />
meaning that logistics teams can determine if<br />
their stuffs safe, on time and has been transported<br />
under the right conditions, thus avoiding<br />
loss and spoilage.<br />
In <strong>Smart</strong> Factories, or as the Europeans prefer<br />
to call it, <strong>Industry</strong> 4.0 machines, will take over<br />
mundane and repetitive tasks on the assembly<br />
line, freeing qualified workers for more<br />
demanding tasks where lack of talent is being<br />
felt around the world. Using powerful AI tools<br />
such as image recognition and analysis, manufactures<br />
will dramatically raise quality with<br />
hope of achieving the golden grail of making<br />
stuff – zero-reject production.<br />
The hospitality business rocked by lack of people<br />
willing to work for sweatshop wages will<br />
have to invest heavily in automation provided<br />
by IoT in everything from “connected rooms”<br />
where everything from temperature control to<br />
room service to lowering the blinds and turning<br />
on the TV will be guided by Alexa-style<br />
gadgets and smartphone that enhance the<br />
guest experience. And in maintenance where<br />
hotels spend a lot, IoT sensors can help to reduce<br />
this expenditure by detect problem and<br />
notify staff, for instance about faulty lighting<br />
and other fixes.<br />
The Internet of Things brings numerous opportunities<br />
for any business to transform itself.<br />
Companies like our sponsor Avnet Silica<br />
and many others will be happy to point out<br />
ways in which, you, too, can reap the benefits<br />
of IoT a myriad of practical use cases and applications.<br />
In you aren’t there yet, setting out<br />
on your journey to the connected future has<br />
never been easier. Bon voyage!<br />
3
contents Imprint<br />
CONTENTs<br />
03 Editorial<br />
04 Contents/Imprint<br />
06 <strong>Smart</strong> People<br />
24<br />
Welcome to the Metaverse<br />
Online communities have existed since at least the mid-1980s, but the metaverse could represent<br />
a whole new dimension. Imagine it as an online virtual world which incorporates augmented<br />
reality, virtual reality, 3D holographic avatars, video and other means of communication. As<br />
the metaverse expands, it will offer a hyper-real alternative world for you to coexist in.<br />
<strong>Smart</strong> Business<br />
12 The Man Machine: Building a Better Brain<br />
24 The Metaverse: No Time for Fun & Games<br />
29 Avnet Column: Gilles Beltran<br />
30 The Future of IoT<br />
34 Interview: Lou Lutostanski<br />
38 Why IoT Projects Fail<br />
42 IIoT: How to Eat an Elephant<br />
<strong>Smart</strong> Communications<br />
46 Keep on Trucking<br />
52 Taking Security to the Edge<br />
58 EV Charging: Current Trends<br />
58<br />
Current Trends<br />
The electric vehicle industry is on its way to market maturity but there are still twists in the road<br />
for stakeholders and customers. From accessibility and standardization issues to a lack of convenient<br />
and secure payment methods at charging stations, unresolved issues could still throw a<br />
spoke in the wheel of electric vehicles, leaving full adoption out of reach.<br />
<strong>Smart</strong> Lifestyle<br />
62 The <strong>Smart</strong>est City<br />
66 Internet of Trees: Fighting Forest Fires with IoT<br />
72 Taking 5G to the Max<br />
76 Interview: The World is Shrinking<br />
<strong>Smart</strong> Solutions<br />
78 Old Data for Sale<br />
82 Lidar<br />
86 Bernd Schöne: Liquid Software<br />
88 <strong>Smart</strong> Sensors: <strong>Smart</strong> Eyes for IoT<br />
90 <strong>Smart</strong> Companies<br />
92 One More Thing<br />
62<br />
The <strong>Smart</strong>est City<br />
Poblenau, formerly a run-down suburb of Barcelona, has reinvented itself as a neighbourhood<br />
buzzing with innovative startups, research centres and international businesses.<br />
Today, it is regularly touted as a template for urban, economic and social renewal, as well as<br />
a hotbed of IT innovation.<br />
98 Gerd Leonhard: The Future Looks Great!<br />
4
12<br />
The Man Machine<br />
The idea of linking the human brain to machines and<br />
to each other is intriguing and far from new. But now<br />
the dream of countless Sci-Fi readers may be coming<br />
true at last. Will we soon be able to control our smart<br />
machines simply through thought? Maybe it’s time to<br />
rethink our relationship with technology.<br />
IMPrint<br />
Publisher<br />
Avnet Silica (Avnet EMG GmbH), Gruberstrasse 60d,<br />
85586 Poing, Germany<br />
Production and Project Management<br />
RSP Management GmbH, Hohenbrunner Weg 41B,<br />
82024 Taufkirchen, rspitz@rsp-publishing.de<br />
Square Publishing GmbH,<br />
Bretonischer Ring 10, 85630 Grasbrunn<br />
Project manager Richard Spitz<br />
Editor-in-chief Tim Cole<br />
Text editor Eric Doyle<br />
Art director Sara D’Auria, www.inframedesign.de,<br />
Harald Sayffaerth, www.01graphics.de<br />
Contributors Göran Appelquist, Gilles Beltran,<br />
Rainer Claaßen, Marc McCoy, Sebastian Ganschow,<br />
Alan Earls, Gordon Feller, John Koon, Greg Langley,<br />
Tom Leddo, Gerd Leonhard, Michael Moorfield,<br />
Stian Overdahl, Bernd Schöne<br />
Pictures Shutterstock, Fotolia<br />
Production manager Stephan Quinkertz<br />
Printing Westermann<br />
Managing director Richard Spitz, Stephan Quinkertz<br />
© <strong>2022</strong> RSP Management GmbH and<br />
Square Publishing GmbH<br />
INTRODUCING THE MICROSOFT AZURE<br />
SPHERE ENABLED LORA GATEWAY<br />
One of the most secure and easy to manage<br />
gateways, featuring Azure Sphere<br />
• Securely monitors, tracks and manages data in<br />
almost every environment, from buildings to factories,<br />
smart cities, hospitals, agriculture and retail<br />
• Supports cellular, Wi-Fi and Ethernet connectivity<br />
• Remotely upgrade your gateways in the field, with<br />
daily authentication of hardware and software,<br />
and a failsafe over the air update mechanism<br />
• Guaranteed maintenance over the lifetime of<br />
the product<br />
• Pre-integrated security will ensure that your<br />
LoRaWAN gateway is secure and safe of the risk<br />
from cyber-attacks<br />
avnet-silica.com<br />
REQUEST<br />
DEMO
<strong>Smart</strong> People Behind the scenes<br />
Behind the Scenes<br />
<strong>Smart</strong> people<br />
All over the world, brilliant individuals are hard at work creating the technologies and<br />
solutions that will one day make the Internet of Things come alive. We visited a few<br />
of them and listened to their fascinating stories.<br />
Stockholm University<br />
Artificial Intelligence<br />
for the Planet<br />
Swedish resilience researcher<br />
Victor Galaz believes that artificial<br />
intelligence should follow the<br />
dictates of sustainability in the<br />
context of the environment and<br />
climate change. “Like many other<br />
technologies, artificial intelligence<br />
offers a mixture of opportunities<br />
and risks with regard to climate<br />
change,” he says.<br />
Crunching the<br />
Climate Numbers<br />
While AI offers more<br />
postive than negative<br />
impacts on the climate,<br />
more work still<br />
needs to be done to<br />
extract correlations<br />
from the mountains<br />
of data available.<br />
As associate professor in political<br />
science and deputy director of<br />
the Stockholm Resilience Centre<br />
at Stockholm University, Galaz recently<br />
gave a much-discussed lecture<br />
on Planetary Responsible AI at<br />
the Complexity Science Hub Vienna<br />
(CSH), where he focused on the<br />
ethical perspective of AI which he<br />
maintains must always be included<br />
in the design and use of AI systems<br />
– whether to design them according<br />
to principles of inclusion and diversity,<br />
or to reflect on the dilemmas of<br />
self-driving cars which one day may<br />
have to decide on the life and death<br />
of road-using humans.<br />
That AI offers numerous opportunities<br />
to halt or even reverse climate<br />
change is obvious: relevant patterns,<br />
changes or correlations can<br />
be extracted automatically from the<br />
growing mountains of data resulting<br />
from the monitoring of our environment.<br />
Galaz emphasises that the predictive<br />
power of artificial intelligence offers<br />
a major advantage. He believes<br />
A Positive impacts of Al: 79 % (71 %) B Negative impacts of Al: 35 % (23 %)<br />
source ©: Springer Nature Limited<br />
17<br />
12<br />
13<br />
9<br />
15<br />
8<br />
1<br />
100%<br />
100%<br />
14<br />
(100%) 75%<br />
(88%) (69%) 3<br />
90%<br />
69%<br />
(90%)<br />
(69%)<br />
80%<br />
100% 4<br />
(70%)<br />
(93%)<br />
26%<br />
56%<br />
(15%)<br />
(44%)<br />
82%<br />
100%<br />
(59%)<br />
(100%)<br />
90%<br />
100%<br />
(75%)<br />
(100%)<br />
10 100%<br />
100%<br />
(91%) 92% 58% (90%)<br />
7<br />
(77%) (52%)<br />
Enviroment: 93% (85%)<br />
Economy: 70% (55%)<br />
16<br />
2<br />
11<br />
6<br />
5<br />
Society: 82% (77%)<br />
17<br />
12<br />
13<br />
9<br />
15<br />
8<br />
1<br />
86%<br />
33% (43%) 25%<br />
(8%)<br />
3<br />
14<br />
30%<br />
(13%) 8%<br />
(13%)<br />
(8%)<br />
20%<br />
70% 4<br />
(20%)<br />
(60%)<br />
11%<br />
33%<br />
(5%)<br />
(31%)<br />
27%<br />
63%<br />
(16%)<br />
(28%)<br />
70%<br />
40%<br />
(55%)<br />
(40%)<br />
10 50%<br />
20%<br />
(34%) 33% 25% (10%)<br />
7<br />
(25%) (15%)<br />
Enviroment: 30% (12%)<br />
Economy: 33% (23%)<br />
16<br />
2<br />
11<br />
6<br />
5<br />
Society: 38% (25%)<br />
1 No Poverty<br />
2 Zero Hunger<br />
3 Good Health and Well-Being<br />
4 Quality Education<br />
5 Gender Equality<br />
6 Clean Water and Sanitation<br />
7 Affordable and Clean Energy<br />
8 Decent Work and Economic Growth<br />
9 <strong>Industry</strong>, Innovation, and Infrastructure<br />
10 Reduced Inequalities<br />
11 Sustainable Cities and Communities<br />
12 Responsible Consumption and Production<br />
13 Climate Action<br />
14 Life Below Water<br />
15 Life on Land<br />
16 Peace, Justice and Strong Institutions<br />
17 Partnerships<br />
6
that, with improved data availability,<br />
predictive modeling of climate data<br />
will make it possible to estimate developments<br />
ever more accurately<br />
and locally. AI already plays a role in<br />
the optimisation of existing systems<br />
– for example, in the more efficient<br />
use of renewable energies.<br />
High benefits also require the responsible<br />
use of the systems and<br />
Galaz's central question is: “How do<br />
we ensure that AI does not intensify<br />
environmental degradation, misinformation<br />
and social inequality?”<br />
Artificial intelligence is already being<br />
used in many variations in the<br />
field of smart farming worldwide,<br />
for example, using satellite data to<br />
optimise irrigation, pesticide use<br />
and harvesting times. To Galaz, it is<br />
unclear what ecological effects such<br />
digital agriculture, forestry and water<br />
management will have and this<br />
AI offers a mix<br />
of opportunities<br />
and risks.<br />
Victor Galaz<br />
Associate professor in<br />
political science and deputy<br />
director of the Stockholm Resilience<br />
Centre at Stockholm<br />
University<br />
raises a social question. Galaz asks:<br />
"Will the advantages resulting from<br />
automation be evenly distributed or,<br />
for example, will it have a negative<br />
impact on small farmers in African or<br />
Asian countries?”<br />
source ©: Goethe-Institut<br />
AN ENGINEER’S<br />
GUIDE TO 5G –<br />
AVNET SILICA’S NEW<br />
RESOURCE FOR<br />
DESIGNERS<br />
There has never been a better<br />
time to accelerate your 5G design<br />
journey. From infrastructure<br />
to endpoint, 5G will reach into<br />
every aspect of our business and<br />
personal lives. And there is no<br />
better place to fuel that journey<br />
than Avnet Silica’s 5G solutions<br />
page.<br />
DOWNLOAD<br />
EBOOK<br />
avnet-silica.com
<strong>Smart</strong> People Behind the scenes<br />
source ©: LinkedIn Corporation<br />
source ©: Davey Bickford Enaex source ©: Aspermont Media Ltd<br />
Davey Bickford Enaex<br />
Having a Blast and<br />
Still Staying Safe<br />
The most dangerous moment in<br />
mining is when someone lights<br />
the fuse and everybody starts<br />
running. Aymeric Denuelle, a<br />
researcher and group product<br />
marketing manager at mining<br />
How to Achieve a<br />
Better Blast<br />
IoT enhanced<br />
detonators provide<br />
a higher level of accuracy<br />
and reliability,<br />
improving blast performance<br />
while offering<br />
a user friendly<br />
human machine<br />
interface allowing<br />
fast programming.<br />
Time is money<br />
in the mining<br />
industry.<br />
Aymeric Denuelle<br />
Researcher and group<br />
product marketing manager<br />
at mining services company<br />
Davey Bickford Enaex<br />
services company Davey Bickford<br />
Enaex, wants to defuse the situation<br />
with its DaveyTronic Edge<br />
remote control electronic detonator.<br />
The system uses a common<br />
IoT radio frequency protocol to<br />
communicate with up to thousands<br />
of detonators before triggering<br />
each explosive device.<br />
Electronic detonators have been<br />
around since the 90s but, Denuelle<br />
says, they had an Achilles heel<br />
because the complex fixed-wire<br />
networks connecting the detonators<br />
to the blasting machines<br />
were prone to electrical leakage.<br />
Early wireless detonators were<br />
unidirectional – in other words,<br />
signals could be sent to a detonator,<br />
but no response could be<br />
received. DaveyTronic Edge not<br />
only does away with the need<br />
for surface wiring but also controls<br />
multiple electronic detonators<br />
from a single, safe location,<br />
thereby making the blasting<br />
process less risky and more efficient.<br />
Until now, mining workers were<br />
forced to manually check conditions<br />
before pressing the button<br />
– a process known as ‘priming<br />
the blast’. This is costly and<br />
time consuming, as well as risky<br />
in the event of human error,<br />
but the main worry was finding<br />
detonators that failed to go off,<br />
which meant searching for hours<br />
through huge piles of debris.<br />
The new system has been successfully<br />
tested in a large mine in<br />
Chile, where it proved capable of<br />
operating safely over a distance<br />
of several kilometres. As Denuelle<br />
says, “Our goal is to always<br />
provide safer solutions so that<br />
our customers can trigger larger<br />
blasts from a remote firing point.<br />
Time is money in this industry and<br />
mining companies need to spend<br />
more time collecting the ore than<br />
organising the blast."<br />
8
MORE EXPERTISE<br />
LESS COMPLEXITY<br />
Bipolar<br />
transistors<br />
Diodes Analog &<br />
MOSFETs GaN FETs<br />
Logic ICs<br />
ESD protection, TVS, filtering<br />
and signal conditioning<br />
It’s never been easier to complete your design, with essential components and expert support from<br />
Nexperia. Search & specify all your discrete and MOSFET components, analog and Logic ICs, directly online.<br />
You’ll quickly find what you need from our portfolio of 15,000+ devices, industry-leading small packages,<br />
meeting the highest industry standards.<br />
For easy access to the essential components, get more with Nexperia.<br />
nexperia.com
<strong>Smart</strong> People Behind the scenes<br />
Omni:us<br />
Taking a Flyer<br />
on Insurance AI<br />
"I like to take risks. That's how I was<br />
brought up", says Sofie Quidenus-<br />
Wahlforss, founder and CEO of<br />
Omni:us, based in Berlin. The serial<br />
entrepreneur founded her first<br />
company in Vienna while still attending<br />
high school. Now, with<br />
Omni:us, her fourth company,<br />
she is using artificial intelligence<br />
to disrupt the insurance industry.<br />
Following the company’s launch<br />
Quidenus-Wahlforss made the<br />
Forbes list of Europe's Top 50 Women<br />
in Tech.<br />
"When I was a little kid, I used to<br />
climb to the top of the tallest trees,"<br />
she recalls, adding that it was always<br />
important to her parents that<br />
she gained as much experience as<br />
possible. "When I fell from the tree,<br />
that was also an experience and it<br />
showed that I was brave."<br />
Omni:us uses artificial intelligence<br />
to digitally capture documents,<br />
including handwritten ones, to<br />
automatically evaluate them and<br />
understand what they are about.<br />
As a kid, I used<br />
to climb to the<br />
top of the tallest<br />
trees.<br />
Sofie<br />
Quidenus-Wahlforss<br />
Founder and CEO<br />
of Omni:us, based in Berlin<br />
Omni:us Classifies<br />
Documents<br />
into predefined<br />
categories based<br />
on visual and<br />
textual information<br />
and retrieves data<br />
using end2end information<br />
extraction<br />
techniques.<br />
The system learns as it goes and<br />
its analytical skills get increasingly<br />
better. Omni:us is focusing on the<br />
insurance industry. "That's where<br />
we see the greatest potential because<br />
everyone deals with insurances,"<br />
Quidenus-Wahlforss maintains.<br />
The startup earns money by<br />
selling licenses for its software.<br />
As an entrepreneur, she has learned<br />
to deal with setbacks. "I can only<br />
do this if I believe in it," she says.<br />
Quidenus-Wahlforss is firmly convinced<br />
that artificial intelligence is<br />
source ©: omni:us / Qidenus Group GmbH<br />
capable of taking the paperwork<br />
away from an insurance company's<br />
clerks so that they have more time<br />
for their customers’ needs. "It's not<br />
about replacing the employee but<br />
enabling them to focus on what<br />
they can do; namely, empathic<br />
behaviour," she explains. "No one<br />
wants a machine to end up making<br />
decisions."<br />
International investors have apparently<br />
been won over by this<br />
idea, investing a total of around<br />
€20 million in Omni:us. Many large<br />
insurance companies are already<br />
working with Omni:us, currently<br />
one of the largest German insurers<br />
Wüstenrot is running a proof-ofconcept<br />
test project.<br />
Omni:us is part of the Qidenus<br />
Group, which may look like a misspelling.<br />
In fact, Quidenus-Wahlforss<br />
had the “u” removed deliberately<br />
– something her parents<br />
and her grandmother, in particular,<br />
remain irritated about. "I kind of<br />
thought it was cooler without the<br />
‘u’," Sofie explains. "Qi is the Chinese<br />
word for energy and if you flip<br />
the letters around it's IQ. Both just<br />
fit well."<br />
source ©: omni:us / Qidenus Group GmbH<br />
10
nRF9160<br />
Low power cellular SiP with integrated<br />
LTE-M/NB-IoT modem and GPS<br />
Start your development today with the most<br />
compact, complete and energy-efficient<br />
cellular IoT solution on the market<br />
AVAILABLE NOW<br />
nordicsemi.com/nRF9160
<strong>Smart</strong> Business Title Story: Augmented Humanity<br />
Augmented Humanity<br />
THE<br />
MAN MACHINE<br />
Psychokinesis, or mind over matter, is a popular dream<br />
of sci-fi and horror story writers. In the digital world, dreams often come<br />
true and there are signs that soon we may be able to complete tasks<br />
without moving off our sofas. Remote control is changing<br />
to cerebral control – if you think it, you can do it.<br />
n By Alan R. Earls<br />
The idea of linking humans<br />
with the machines we have<br />
created and to each other is<br />
intriguing and far from new.<br />
Today, many people carry a multitude<br />
of electronic signatures and<br />
interfaces. The smartphone is the<br />
most obvious and most capable,<br />
but credit cards also carry chips<br />
with personal information and, with<br />
the pandemic ongoing, the idea of<br />
chipping vaccinated people is not<br />
out of the realm of possibility – and<br />
let’s not forget our biometric signatures.<br />
Despite their usefulness, all<br />
of these require manual manipulation.<br />
Maybe it’s time to rethink the<br />
processes by just thinking about the<br />
process.<br />
Science fiction has ridden the concept<br />
of controlling things with the<br />
power of the mind for years, notably<br />
Firefox, a Clint Eastwood thriller involving<br />
a thought-controlled fighter<br />
jet. The reality of this has been<br />
getting closer of late.<br />
Facebook shared ideas about<br />
thought-to-text capabilities in 2017,<br />
shortly after entrepreneur Elon<br />
Musk announced his plans to build<br />
Neuralink, a firm promising to `wire’<br />
brains in the future. Startups and<br />
research projects are now emerging<br />
across the globe and the key<br />
to much of this future is the `brain<br />
computer interface’ (BCI).<br />
Alexandre Gonfalonieri, an AI consultant<br />
based in Switzerland and<br />
head of innovation at DNA<br />
12
13
<strong>Smart</strong> Business Title Story: Augmented Humanity<br />
source ©: Ars Electronica Linz GmbH & Co KG<br />
To Think it is to<br />
Do it<br />
Wacker Neuson<br />
challenged visitors<br />
to Ars Electronica in<br />
Linz to operate its<br />
heavy construction<br />
equipment entirely<br />
by eye movement<br />
and thought control.<br />
Your BCI could<br />
detect that your<br />
attention level is<br />
too low or adapt<br />
the lighting<br />
based on how<br />
stressed you are.<br />
Alexandre Gonfalonieri<br />
DNA Global Analytics<br />
nual expo in Linz, Austria, that celebrates<br />
advances in digitalisation,<br />
Wacker Neuson, a British manufacturer<br />
of heavy construction equipment,<br />
challenged visitors to steer a<br />
15-ton backhoe excavator entirely<br />
by eye movement and brain power.<br />
The company envisages applications<br />
for this new technology in controlling<br />
heavy machinery in tight or<br />
hazardous environments where human<br />
operators would be in danger.<br />
Release the Beast<br />
A lot comes down to definitions,<br />
says Evan Coopersmith, executive<br />
VP of data science at AE Studio, a<br />
source ©: Medium<br />
Global Analytics, recently wrote in<br />
the Harvard Business Review, “The<br />
development of BCI technology<br />
was initially focused on helping paralysed<br />
people control assistive devices<br />
using their thoughts, but new<br />
use cases are being identified all the<br />
time. For example, BCIs can now be<br />
used as a neuro-feedback training<br />
tool to improve cognitive performance.<br />
I expect to see a growing<br />
number of professionals leveraging<br />
BCI tools to improve their performance<br />
at work. For example, your<br />
BCI could detect that your attention<br />
level is too low, compared with the<br />
importance of a given meeting or<br />
task, and trigger an alert. It could<br />
also adapt the lighting of your office<br />
based on how stressed you are or<br />
prevent you from using your company<br />
car if drowsiness is detected.”<br />
Imagine, Gonfalonieri says, if your<br />
manager could know whether you<br />
actually paid attention in your last<br />
Zoom meeting. Imagine if you could<br />
prepare your next presentation using<br />
only your thoughts. Scenarios<br />
like this might soon become a reality<br />
thanks to developments in the field.<br />
BCIs may even find their way into<br />
such mundane tasks as steering an<br />
excavator. At Ars Electronica, an ansoftware<br />
development and data<br />
science venture studio that conducts<br />
projects for clients and also<br />
funds its own BCI research. “Right<br />
now, we think of BCI in terms of<br />
something internal to a person<br />
manifesting as external action,”<br />
he says. Is a cochlear implant BCI?<br />
Yes, says Coopersmith, though he<br />
admits that others might disagree<br />
with that assessment. A BCI could<br />
also be a device that notifies the<br />
brain of an oncoming seizure. “I<br />
would say anything that is a neurological<br />
interface that connects the<br />
brain to the outside world, in either<br />
direction, is BCI and I think those<br />
boundaries will increasingly blur,”<br />
he explains.<br />
The work AE Studio is pursuing<br />
is leading edge but without any<br />
literal cutting edge involved. Coopersmith<br />
says implanting devices<br />
in someone’s skull is not the name<br />
of the game. Rather, he sees an<br />
opportunity to make better use of<br />
what can be learned from brain activity<br />
to get to a much more powerful<br />
kind of interface than is available<br />
today.<br />
“Our expertise is in software development<br />
and machine learning,<br />
and in understanding data,”<br />
14
Invasive IoT<br />
The Internet of Bodies<br />
IoB Examples<br />
source ©: RAND Corporation<br />
Cochlear<br />
implant<br />
Electronic<br />
tattoo<br />
Self-lacing<br />
shoes<br />
Bluetoothconnected<br />
diaper<br />
Wearable baby<br />
monitor<br />
Depression headset<br />
Augmented reality<br />
contact lens<br />
Wearable UV monitor<br />
Pacemaker<br />
Microchip implant<br />
<strong>Smart</strong>phone with<br />
health apps<br />
Prosthetic<br />
Temperature-sensing pacifier<br />
Antidrowning monitor<br />
Sleep-tracking onesie<br />
Brain interfaces may be a future goal<br />
but, here and now, WiFi devices are<br />
increasingly becoming integral to<br />
the delivery of quality healthcare.<br />
Common devices such as sleep<br />
trackers and heart monitors are a<br />
reality but researchers at The Rand<br />
Corporation, a think-tank, want to<br />
take the link between humans and<br />
machines a step further – literally.<br />
Swallow and Collect<br />
They imagine an era of the Internet<br />
of Bodies: a range of devices that<br />
can be implanted, swallowed or<br />
worn in order to collect and transmit<br />
data about our physical states<br />
over the internet. The result will be a<br />
huge amount of health-related data<br />
that could improve human wellbeing<br />
and prove crucial in fighting the<br />
Covid-19 pandemic.<br />
VivaLNK, a startup based in Silicon<br />
Valley, for instance, has developed<br />
smart thermometers marketed under<br />
the brand name Fever Scout.<br />
Unlike traditional thermometers,<br />
which usually involve long tubes,<br />
Intraocular lens<br />
with camera<br />
Internet-connected<br />
glasses<br />
Tooth-mounted<br />
sensor<br />
Electronic pill<br />
Clothing with<br />
temperature monitoring<br />
Fertility measurement<br />
device<br />
Internet-connected<br />
scale<br />
Internet-connected<br />
toilet<br />
VivaLNK has created peel-and-stick<br />
thermopatches that connect via a<br />
smartphone app and have already<br />
received Food and Drug Administration<br />
(FDA) clearance in the US.<br />
The company believes its product<br />
is especially suitable for monitoring<br />
child patients.<br />
For health professionals, the Internet<br />
of Bodies opens the gate to a<br />
new era of effective monitoring and<br />
treatment. In 2017, the US Federal<br />
Drug Administration approved the<br />
first use of digital pills in the United<br />
States. Digital pills contain tiny, ingestible<br />
sensors as well as medicine.<br />
Once swallowed, the sensor is activated<br />
in the patient’s stomach and<br />
transmits data to a smartphone or<br />
other devices.<br />
Meditation headset<br />
Bluetooth-connected<br />
hearing aid<br />
<strong>Smart</strong> watch/<br />
fitness tracker<br />
Temperature bracelet<br />
Artificial pancreas<br />
Electronic health<br />
records (EHRs)<br />
Sleep-sensing<br />
mattress<br />
Not Just a Patch-over<br />
VivaLnk, a Santa Clara-based<br />
connected health startup, has<br />
received FDA clearance for its<br />
first device, a peel-and-stick<br />
patch thermometer for children<br />
called Fever Scout.<br />
IoT Gets Physical<br />
From AR contact lenses to artificial<br />
pancreas and Bluetooth<br />
connected diapers: No part of<br />
the human body will remain<br />
untouches by IoB technology,<br />
says RAND.<br />
Virtual Rehab<br />
In 2018, Kaiser Permanente, a healthcare<br />
provider in California, started a<br />
virtual rehab programme for patients<br />
recovering from heart attacks.<br />
The patients shared their data with<br />
their care providers through a smartwatch,<br />
allowing for better monitoring<br />
and a closer, more continuous<br />
relationship between patient and<br />
doctor. Thanks to this innovation,<br />
the completion rate of the rehab<br />
programme rose from less than 50<br />
percent to 87 percent, accompanied<br />
by a fall in the re-admission rate and<br />
programme cost.<br />
Scientists at The Rand Corporation<br />
are studying the rapid growth of<br />
this technology, as well as the broad<br />
privacy and policy issues these developments<br />
raise. In particular, they<br />
are trying to assess the benefits and<br />
risks, the regulatory picture, and<br />
how best to balance risks and rewards<br />
going forward.<br />
source ©: Wareable Ltd<br />
15
<strong>Smart</strong> Business Title Story: Augmented Humanity<br />
Silent Speech<br />
Close, but not Close<br />
Enough (Yet)<br />
source ©: Facebook<br />
Giving AR and VR<br />
a Hand<br />
Sean Keller, Meta's<br />
head of research,<br />
is inventing soft,<br />
lightweight haptic<br />
gloves that can bring<br />
full hand presence<br />
into AR and VR.<br />
Housed in its top-secret Skunkworks<br />
tucked away in Building 8 on<br />
Meta’s campus in Menlo Park, Facebook<br />
Reality Labs (FRL) worked on a<br />
project to build a headset or headband<br />
to allow people to send text<br />
messages by thinking – tapping<br />
them out at 100 words per minute.<br />
Though last year Facebook decided<br />
16<br />
Touchie Feelie<br />
To deliver a realistic<br />
sense of touch, a haptic<br />
glove needs hundreds of<br />
actuators (tiny motors)<br />
all over the hand, moving<br />
in concert in a way that<br />
makes the wearer feel<br />
like they’re touching a<br />
virtual object.<br />
Scientists from the<br />
University of San<br />
Francisco<br />
working with Facebook<br />
have developed a wearable<br />
prototype that uses<br />
near-infrared light to measure<br />
blood oxygenation<br />
in the brain and indirectly<br />
measure brain activity in a<br />
safe, non-invasive way.<br />
source ©: Facebook<br />
to put this ‘silent speech’ project on<br />
the backburner for a while, Regina<br />
Dugan, who was then head of the<br />
Building 8 hardware division, remains<br />
a believer. “It sounds impossible<br />
but it’s closer than you realise,”<br />
she told Technology Review.<br />
It now seems it was not quite close<br />
source ©: Facebook<br />
enough. In a blog post last April,<br />
FRL research director Sean Keller<br />
said the team was happy to say that<br />
“for the first time, someone with<br />
severe speech loss has been able to<br />
type out what they wanted to say<br />
almost instantly, simply by attempting<br />
to speak”. However, he added<br />
that Facebook decided to transfer<br />
its results to the broader neuroscience<br />
community, effectively releasing<br />
it into the wild where it will<br />
continue its existence as an opensource<br />
project.<br />
“While we still believe in the longterm<br />
potential of head-mounted<br />
optical BCI technologies, we’ve<br />
decided to focus our immediate efforts<br />
on a different neural interface<br />
approach that has a nearer-term<br />
path to market: wrist-based devices<br />
powered by electromyography,”<br />
he explained. Electromyography<br />
(EMG) is a technique for analysing<br />
and recording the electrical activity<br />
produced by skeletal muscles.<br />
EMG can pick up and decode the<br />
signals for hand and finger movements<br />
at the wrist and translate<br />
them into digital commands for a<br />
device. In the near term, these signals<br />
will let people communicate<br />
with their devices with a degree of<br />
control that’s highly reliable, subtle,<br />
personalisable and adaptable to<br />
many situations. As this area of research<br />
evolves, EMG-based neural<br />
interfaces have the potential to dramatically<br />
expand the bandwidth<br />
with which we can communicate<br />
with our devices, opening up the<br />
possibility of things like high-speed<br />
typing.
source ©: UPMC, Pitt Health Science<br />
he says. No two brains are identical<br />
and they can produce a broad<br />
range of electrical responses. The<br />
challenge, he believes, is understanding<br />
how to interpret those<br />
responses and fit that knowledge<br />
into other evidence and, thereby,<br />
enhance our means of interacting.<br />
Coopersmith’s other aspiration is<br />
to see BCI developed by neutral<br />
parties rather than big, for-profit<br />
enterprises that may be tempted<br />
to use what they learn to supercharge<br />
their marketing. “The risk is<br />
both for some upstart looking to<br />
become the next Facebook/Meta,<br />
as well as Meta itself attempting to<br />
gain even more intimate access to<br />
our thought patterns,” he says. “We<br />
see this [approach to BCI] as aligning<br />
with the goals of a Web3 or Web<br />
3.0 that is more decentralised than<br />
what we have today.”<br />
For now, BCI is still mostly useful<br />
for people who have some degree<br />
of diminished agency, for example<br />
those dealing with paralysis, but<br />
here, too, targets are shifting. “We<br />
don’t know how we will define<br />
agency in 20 to 50 years; we went<br />
from a 12-second flight on a beach<br />
[the Wright brothers, 1903) to landing<br />
on the moon [1969], events<br />
separated by just 66 years,” Coopersmith<br />
notes. “It is hubristic to<br />
predict what BCI will do.” Nonetheless,<br />
it seems likely that human beings<br />
will increasingly interact with<br />
the world and each other through<br />
the mediation of technology.<br />
Pittsburgh's<br />
RNEL<br />
lab is investigating<br />
the feasibility<br />
of using<br />
intracortical<br />
microelectrode<br />
arrays implanted<br />
in motor cortex<br />
for providing<br />
high degree of<br />
freedom control<br />
of a robotic arm.<br />
The pandemic<br />
accelerated<br />
our plans for<br />
in-home testing<br />
but this has<br />
been a goal for<br />
a long time.<br />
Jennifer L. Collinger<br />
University of Pittsburgh<br />
Rehab Neural Engineering<br />
Labs (RNEL)<br />
The direction things are heading is<br />
obvious. In May of this year, a team<br />
of neural engineers at the University<br />
of Pittsburgh’s Rehab Neural<br />
Engineering Labs (RNEL) published<br />
a proof-of-principle for a bidirectional<br />
BCI – a type of BCI that enables<br />
not just data reading but also<br />
provides feedback through data<br />
writing abilities.<br />
Taking Control<br />
In other words, it enables patients<br />
with paralysis to control a rosource<br />
©: UPMC, Pitt Health Science<br />
source ©: University of Pittsburgh, Rehab Neural Engineering Labs<br />
17
<strong>Smart</strong> Business Title Story: Augmented Humanity<br />
botic arm using their thoughts and<br />
enables them to feel how hard the<br />
arm is clutching an object. Study<br />
participants were able to take control,<br />
without assistance from the researchers,<br />
to perform difficult tasks<br />
from home.<br />
Jennifer Collinger, the senior author<br />
on this report, believes this proves<br />
that BCI studies no longer need to<br />
be restricted to an on-site lab. “The<br />
pandemic accelerated our plans for<br />
in-home testing but this has been a<br />
goal for a long time,” she explains.<br />
“We need to get the technology<br />
into real-world environments. We<br />
just want study participants to be<br />
able to do the things they want to<br />
do with a BCI.”<br />
It’s All in Your Head<br />
BCI is in fact already an industry<br />
segment of significant size. A recent<br />
study, Brain Computer Interface<br />
source ©: Next Reality, WonderHowTo<br />
The new Reality<br />
Qualcomm's latest<br />
AR headset supports<br />
seven cameras,<br />
including two internal<br />
cameras for eye<br />
tracking and four external<br />
cameras which<br />
give the wearer the<br />
capability of spatial<br />
mapping.<br />
Market Size, Share & Trends Analysis<br />
Report by Grand View Research, an<br />
Indian consultancy, says the global<br />
brain-computer interface market<br />
size was valued at $1.2 billion in<br />
2019 and is anticipated to grow<br />
at an annual rate of 15.5 percent<br />
through 2027.<br />
According to this report, braincomputer<br />
interface technology is<br />
increasingly used in mobile and<br />
virtual gaming industries by integrating<br />
BCI within virtual reality<br />
(VR) headsets. Virtual gaming has<br />
opened a plethora of new opportunities<br />
for mind-controlled headsets<br />
and gadgets, which is further<br />
driving the adoption of brain-controlled<br />
interface technology. Manufacturers<br />
are increasingly focusing<br />
Elon Musk in his Own Words<br />
“A FitBit in Your Skull”<br />
"Think of Neuralink like a FitBit in<br />
your skull. Or an Apple Watch. So,<br />
we take out part of the skull, we replace<br />
that with the chip and the inductive<br />
charger and the Bluetooth<br />
antenna, and it's really quite, almost<br />
literally, like a FitBit in your skull."<br />
From an interview with Kara Swisher<br />
of the New York Times<br />
source ©: Wikipedia / Heisenberg<br />
“I want to be clear, the early applications<br />
will really just be for people<br />
who have a serious brain injury, like,<br />
where it's, like, the value of the implant<br />
is just enormous.”<br />
From Cnet<br />
“Neuralink will seek to solve a number<br />
of neurological diseases. In<br />
the next few years, we'll hopefully<br />
18
on the development of BCI-enabled<br />
video games. Grand View believes<br />
innovations such as these, are likely<br />
to drive the market for brain-controlled<br />
computer interface technology<br />
over the next few years.<br />
International Data Corporation<br />
(IDC) is taking a wider view of the<br />
market, one that includes technologies<br />
such as augmented and virtual<br />
reality (AR/VR), biometrics, exoskeletons,<br />
affective computing, ingestibles,<br />
injectables, implantables,<br />
wearables, and smart devices, as<br />
well as brain-computer interfaces.<br />
The research firm predicts that the<br />
Apple's Private Eyes<br />
The much-rumored Apple<br />
Glasses won't be on the<br />
market until 2023. But<br />
details have leaked out. A<br />
new Apple patent mentions<br />
“privacy eyewear" that aim<br />
to stop people snooping on<br />
your iPhone's display.<br />
source ©: Martin Hajek / iDrop News<br />
European segment of this augmented<br />
humanity (AH) market will reach<br />
over $50 billion by the start of <strong>2022</strong><br />
and more than $100 billion by 2025.<br />
Augmented humanity removes<br />
accessibility barriers that limit humans<br />
from performing their daily<br />
tasks, according to IDC. AH aims to<br />
empower people by developing<br />
data-driven, tech-based, innovative<br />
solutions to enable them to<br />
perform at levels they could not<br />
achieve before.<br />
IDC's The Future of Augmented Humanity<br />
in Europe: 2020–2025 Forecast<br />
estimates that investments in<br />
AH technologies will surge as both<br />
people and corporations invest<br />
in tech to improve their quality of<br />
life and achieve enhanced ways of<br />
working.<br />
Consumer needs change fast but<br />
streamlining and automating domestic<br />
and routine tasks rebe<br />
able to help someone who is a<br />
paraplegic walk again, or someone<br />
whose arms are paralyzed use a<br />
computer again. We hope to have<br />
our first human trials in the next six<br />
months or so.”<br />
From TechWeek Italia<br />
“I think you would, in principle, you<br />
would be able to communicate very<br />
quickly and with far more precision<br />
language, I’m not sure what would<br />
happen to language but in a situation<br />
like this though, it’d be kind of<br />
like the matrix. You want to speak<br />
a different language, no problem.<br />
just download the program.”<br />
From Designboom<br />
“The technology being developed<br />
by Neuralink will allow us to integrate<br />
with computers to access and<br />
process information just as well as<br />
our AI counterparts. Essentially, our<br />
brains will have our very own AI in<br />
a cloud that our brains can synthesize<br />
with as needed. We already<br />
source ©: Neuralink<br />
interface with our computers on a<br />
regular basis, so the jump from an<br />
external device to an internal one<br />
would be a natural progression.“<br />
From Teslarati<br />
“With the direct neural interface,<br />
we can improve the bandwidth<br />
between your cortex and your digital<br />
tertiary layer by many orders of<br />
Doing by Thinking<br />
Thanks to its latest<br />
brain implant, Neuralink<br />
has enabled<br />
a monkey to play<br />
video games through<br />
thought control.<br />
magnitude. I'd say probably at<br />
least 1,000 or maybe 10,000 or<br />
more. And we could also spend<br />
a lot more time thinking about<br />
interesting things, as opposed to<br />
taking complex thought structures,<br />
compressing them down<br />
into words which will also gain<br />
a very low bitrate and then having<br />
someone else receive those<br />
words, decompress them and<br />
then send words back at you.”<br />
From Clubhouse<br />
“The output of the human brain.<br />
This is excruciatingly slow, compared<br />
to, for example, the high<br />
bandwidth of the visual interface<br />
with the brain – the eyes<br />
of people. In other words: data<br />
comes in quickly, but to talk or<br />
type? That process is really slow.<br />
His idea is to capture thoughts<br />
and convert them into text or<br />
movement. Then the humanity<br />
would communicate a lot more<br />
efficiently.“<br />
From superhumantalks<br />
19
<strong>Smart</strong> Business Title Story: Augmented Humanity<br />
VR<br />
Allows the user<br />
to see and hear what<br />
the avatar sees<br />
Gloves<br />
with electrical contacts<br />
at the base of the f<br />
ingers and electrodes<br />
between fingers<br />
Face Projection<br />
Images of the face are<br />
important for the<br />
colleagues experience<br />
Surface EMG<br />
Electrodes<br />
For recording heart rate<br />
and skin moisture<br />
source ©: Human Fusions Institute, Case Western Reserve University<br />
IMUs<br />
Inertial measurement<br />
units<br />
embedded in the<br />
shirt to record<br />
arm movement<br />
Electrode<br />
Mesh<br />
This mesh will<br />
cover muscles of the<br />
arm and chest<br />
Network<br />
Mimicked<br />
Movement<br />
Positional feedback<br />
from the user<br />
Touch<br />
Images of the face are<br />
important for the<br />
colleagues experience<br />
SENSA<br />
The SENSA skeleton<br />
is based on the<br />
RE2 HDMS arms<br />
mains a priority, according to the<br />
report. In fact, investments in smart<br />
devices and wearables will remain<br />
high and will drive a significant<br />
share of the overall AH market.<br />
At the same time, businesses are<br />
searching for tech-based ways to<br />
drive innovation and achieve relevant<br />
key performance indicators<br />
(KPIs), such as lowered costs, increased<br />
productivity and improved<br />
safety. Integration is key and IDC<br />
predicts that in the future we will<br />
see strong investments in integrated<br />
technologies such as Apple's AR<br />
glasses set to launch in 2023.<br />
A Human Need<br />
“For as long as I can remember, I<br />
wanted to be in medicine. I thought<br />
about going into surgery, growing<br />
up, but I love science and math,”<br />
says Dustin Tyler, director of the<br />
Human Fusions Institute at Case<br />
Western Reserve University (CWRU)<br />
in Cleveland, Ohio. His path took an<br />
evolutionary twist when he was in<br />
high school in the early 1980s and<br />
purchased an Atari 800XL, one of<br />
the first personal computers. “That<br />
explains why I didn’t get married<br />
until I was in my 30s,” he quips.<br />
His love of computers, even in their<br />
Working Together<br />
By directly connecting<br />
the human experience to<br />
the Avatar's experience,<br />
the human and the<br />
robotic system become<br />
symbiotically linked.<br />
The human experiences<br />
the world of the robot.<br />
The robot becomes the<br />
extension of the human<br />
and the human intelligence.<br />
We can learn<br />
from both<br />
Turing and<br />
Minsky.<br />
Dustin Tyler<br />
Human Fusions<br />
Institute Case<br />
Western Reserve<br />
University<br />
primitive form, and trying to understand<br />
how to get them to do what<br />
he wanted reconnected him to his<br />
biological interests and the question<br />
of how our brains control our<br />
bodies.<br />
“The brain obviously is fascinating<br />
and the duality between brain and<br />
computer has been very interesting<br />
to me,” Tyler says. In the past,<br />
Alan Turing said we created computers<br />
to serve us but then Marvin<br />
Minsky came along and said that<br />
these machines actually do things<br />
like humans. That perception has<br />
led to some people thinking that AI<br />
is replacing the brain, he observes.<br />
source ©: Bunny Island GmbH<br />
“We can learn from both Turing and<br />
Minsky,” he concludes.<br />
While happy to quote theoreticians,<br />
Tyler is very much results-oriented.<br />
A project he directed allowed a<br />
student at CWRU to touch, feel and<br />
hold a banana that was 2,300 miles<br />
away at the University of California,<br />
Los Angeles (UCLA). It was more<br />
than just a scientific stunt because<br />
it demonstrated the possibility of<br />
placing a prosthesis somewhere<br />
in the world and via ‘neural reality’<br />
someone can literally feel identical<br />
sensations remotely. Of more<br />
immediate consequence, his team<br />
provided the sensation of physical<br />
touch to a prosthesis so an amputee<br />
could safely pick up his granddaughter<br />
or effectively slice a tomato.<br />
The Human Fusions Institute team<br />
is also aiming to win some, or all,<br />
of the Avatar XPrize, a contest<br />
sponsored by Japan’s All Nippon<br />
Airways, which is focused on the<br />
development of an avatar system<br />
that will transport a human’s sense,<br />
actions and presence to a remote<br />
location in real time, leading to a<br />
more connected world.<br />
Pursuing similar goals is Raviraj<br />
Nataraj at the Stevens Institute of<br />
20
source ©: Stevens Institute of Technology<br />
Technology in Hoboken, New Jersey.<br />
His laboratory is creating instrumented<br />
wearables and virtual<br />
reality environments to leverage<br />
sensory feedback and cognitive<br />
factors for training better movement<br />
functions. Clinical solutions<br />
are being developed for people<br />
with neurotraumas, including spinal<br />
cord injury, stroke, traumatic<br />
brain injury and amputation. Restorative<br />
devices of interest include<br />
sensorimotor prostheses and powered<br />
exoskeletons.<br />
Nataraj explains that the challenge<br />
is to command and control prosthetics<br />
more naturally, through biological<br />
signals. Until now that has<br />
been accomplished through muscle<br />
movement but it could also be<br />
done with the brain. “We currently<br />
take measurements at the brain but<br />
more to see how people respond to<br />
the training we are providing,” he<br />
says. That effort is especially crucial<br />
for people dealing with severe motor<br />
disabilities, for whom signaling<br />
through muscles is problematic.<br />
“The principles have been established<br />
but now it is about how to do<br />
it better so we can have an actual<br />
impact at the clinical level,” says Nataraj.<br />
Cost is also an issue, he admits<br />
because specialised, sophisticated<br />
products typically carry a high price<br />
tag.<br />
Gaming the World<br />
Cost associated with new, experimental<br />
technology has often been<br />
addressed by finding a larger-scale<br />
market to drive prices down. While<br />
serious and critical needs in human<br />
wellness and the military are top<br />
targets for BCI, a surprising level of<br />
interest has also materialised in the<br />
‘fun’ segments such as gaming.<br />
The dream here is to create total<br />
immersion into a game world<br />
by linking the gamer’s cognitive<br />
The principles<br />
have been<br />
established<br />
but now it's<br />
about how to<br />
do it better.<br />
Raviraj Nataraj<br />
Stevens Institute<br />
of Technology<br />
A Step Ahead<br />
Researchers have<br />
created a powered,<br />
individualized orthosis<br />
that can automatically<br />
adapt the level<br />
of response, but their<br />
goal is to eventually<br />
get rid of the robot and<br />
walk normally without<br />
the exoskeleton.<br />
perceptions directly to the virtual<br />
environment and allowing direct<br />
control through thought processes.<br />
This dream, at least, is now close to<br />
fruition. Two years ago, computer<br />
scientists at the Graz Technical University<br />
in Austria showcased versions<br />
of such simple, but popular,<br />
video console games as Pong and<br />
Pacman. Users could control the<br />
games through an array of sensors<br />
attached to a close-fitting cap.<br />
Last April, the team managed to<br />
implant a device containing 1,024<br />
electrodes directly into the motorcortex<br />
of a monkey’s brain – the region<br />
of the cerebral cortex involved<br />
in the planning, control and execution<br />
of voluntary movements. The<br />
animal was taught to play Pong<br />
with a joystick and subsequently<br />
learned to control the game by<br />
brainwaves alone.<br />
Gary Yamamoto, CEO of Finch<br />
Technologies, which focuses on<br />
VR and AR technologies, asks, “Today’s<br />
human-machine interfaces<br />
are woefully behind new advances<br />
in technology. What is the purpose<br />
of all these new, incredible technologies<br />
if there aren’t intuitive and<br />
natural ways for people to interact<br />
with them?”<br />
Finch is looking at how AR and VR<br />
applications can include all current<br />
human-machine interfaces (HMIs),<br />
including BCI, computer vision,<br />
voice solutions, inertial measurement<br />
units (IMU) for finger and<br />
hand tracking, eye tracking<br />
source ©: Stevens Institute of Technology<br />
21
<strong>Smart</strong> Business Title Story: Augmented Humanity<br />
source ©: Finch Technologies Ltd<br />
Pointing the Way<br />
The FinchRing is a new kind of wearable<br />
that enables hands-free gesture control<br />
for AV and VR mixed reality.<br />
source ©: Finch Technologies Ltd<br />
and more. Finch’s fusion integrates<br />
third-party technologies with its<br />
own products to move HMI experiences<br />
to the next level and accelerate<br />
the realisation of the Metaverse.<br />
“If we don’t do enough to evolve<br />
human-machine interfaces with<br />
this technology, I fear they may<br />
never reach their full mass-market<br />
potential,” Yamamoto warns. Despite<br />
this, he maintains the company<br />
believes that “sooner than<br />
most expect” we will see a basic<br />
BCI, fused with more conventional<br />
inputs, deliver a broader and more<br />
immersive sensory VR/AR user experience.<br />
Sooner than<br />
most expect,<br />
we will see<br />
a basic BCI.<br />
Gary Yamamoto<br />
Finch Technologies<br />
Technology<br />
will help<br />
humans<br />
elevate their<br />
skills.<br />
Andrea Minonne<br />
IDC Augmented<br />
Humanity Launchpad<br />
source ©: IDC UK Blog<br />
Most significantly in the case of<br />
Musk, the ambition comes with<br />
real misgivings about the growing<br />
power of artificial intelligence and<br />
machine learning and its potential<br />
to at least sideline, if not in fact conquer,<br />
humans. His Neuralink company,<br />
which is working to develop<br />
what it calls a brain-machine interface,<br />
is about levelling that playing<br />
field and giving humans abilities<br />
that will help them compete better<br />
on a planet with billions of connected<br />
things, a growing number<br />
of which are also intelligent.<br />
If anyone is looking for another<br />
reason to pay attention, they can<br />
adopt the IDC view, articulated by<br />
Andrea Minonne, senior research<br />
analyst and co-lead of the Augmented<br />
Humanity Launchpad at<br />
the firm’s UK offices: "Augmented<br />
humanity is the advocate of cultural<br />
change across the commercial<br />
and consumer segments,” he says.<br />
"Promoting an AH-oriented culture<br />
and complementing human skills<br />
with technology will help humans<br />
elevate their skills, automate business<br />
processes or domestic chores,<br />
unlock new capabilities, bring disruption,<br />
promote workforce transformation,<br />
and enable humanised<br />
customer experiences."<br />
Could much the same be said for<br />
BCI itself?<br />
Navigating the Metaverse<br />
Human-machine interfaces<br />
(HMIs) could empower users to<br />
compete with technology in an<br />
interconnected world.<br />
What’s the Point?<br />
While Finch focuses on fun and the<br />
researchers at CWRU and at Stevens<br />
Institute are keen on restoring capabilities<br />
to those with disabilities,<br />
other visionaries, such as billionaire<br />
Musk, are aiming even higher and<br />
have suggested a future in which<br />
our thoughts and desires are also<br />
communicable and actionable<br />
through technology.<br />
22
RENESAS WINNING COMBINATIONS<br />
Combine to Design Faster<br />
The unbeatable combination of Renesas + Dialog delivers comprehensive reference<br />
design solutions from our system architects and FAEs.<br />
These compelling product combinations are starting points to accelerate<br />
designs and get to market faster.<br />
Visit renesas.com/win for all the details on 250+ solutions<br />
to jumpstart your next design today<br />
© <strong>2022</strong> Renesas Electronics America Inc. (REA). All rights reserved. All trademarks are the property of their respective owners.
<strong>Smart</strong> Business Metaverse<br />
Metaverse<br />
No Time for<br />
Fun and Games<br />
For years, the great virtual reality (VR) breakthrough has been expected<br />
but it looks as though it didn’t even happen during the pandemic – at least,<br />
not in the private sector. But the technology is becoming<br />
a great success within many industrial companies.<br />
n By Rainer Claaßen<br />
24
Whether it’s Sony PlayStation<br />
VR, Google Glass<br />
or cardboard mounts<br />
that can turn any<br />
smartphone into a virtual reality (VR)<br />
machine, none of these products has<br />
brought the promised commercial<br />
breakthrough. In fact, some products<br />
appear to have stalled completely.<br />
Though one might conclude from<br />
this that the high hopes many had<br />
in these technologies have been<br />
dashed, it isn’t necessarily so, because<br />
new technologies often reach<br />
the mainstream in unexpected ways.<br />
The pandemic has wrought a change<br />
and VR is finding new applications in<br />
business. No longer restricted to a<br />
few lighthouse projects from huge<br />
companies, the technology has become<br />
more versatile, less expensive<br />
and much easier to access and many<br />
companies have started using VR<br />
and will expand its uses in the years<br />
to come.<br />
In a virtual reality simulation, users<br />
move around in an artificial world,<br />
largely disconnected from reality,<br />
with the help of technical tools. The<br />
immersion is most convincing when<br />
VR headsets are used. They are not<br />
absolutely necessary, because a lot<br />
of content can also be played back<br />
on a smartphone or tablet. These<br />
viewers become a window into an<br />
artificial world. Virtual reality differs<br />
from augmented reality (AR) where<br />
additional information or media is<br />
blended with a real-world, camerasourced<br />
image.<br />
Artificial Worlds<br />
There are two basic ways in which VR<br />
experiences can be produced: by developing<br />
a virtual world in software<br />
from scratch or photographically.<br />
Programming an environment can<br />
be time consuming and expensive<br />
but taking photos and videos that<br />
capture an all-round view offers a<br />
quicker and easier solution. Cameras<br />
like the Ricoh Theta or the Insta 360<br />
are available for just a few hundred<br />
euros, deliver surprisingly good<br />
quality and are almost as easy to operate<br />
as conventional cameras.<br />
A typical application scenario is in in-<br />
source ©: De:central Days<br />
Playing it Serious<br />
It’s no secret that many professional soccer players<br />
are also keen users of game consoles. They are<br />
using VR technology to get better training and many<br />
premier league clubs are choosing tools from sports<br />
technology company Rezzil.<br />
Rezzil’s system allows professional players to hone<br />
different skills, especially headers. Heading a ball is<br />
a health risk, so it is often avoided in training. Being<br />
dustrial workplaces where complex<br />
processes need to be permanently<br />
in operation. Until now, they have<br />
usually been shut down, or run at<br />
reduced speed, to train new employees.<br />
The time spent on this familiarisation<br />
can be drastically reduced<br />
with the help of VR.<br />
Companies can<br />
now create VR<br />
applications very<br />
quickly without<br />
the need for<br />
external support.<br />
Sara Boss<br />
Head of Sales at VRdirect<br />
able to practice without any danger gives teams a<br />
big advantage on match day.<br />
In addition, with full-body tracking and methods to<br />
analyse cognitive characteristics, like scanning, decision<br />
making and pressure coping, the technology<br />
helps to improve their general gameplay. It can also<br />
be useful in injury rehabilitation when training on the<br />
field is not possible.<br />
Virtual Training<br />
VR technology can help<br />
professional soccer<br />
players hone their skills,<br />
for instance headers,<br />
without risk of injury.<br />
Sara Boss, head of sales at VRdirect,<br />
explains, "Without having to spend<br />
a large budget on it, companies can<br />
now create VR applications themselves<br />
very quickly and without the<br />
need for external support. This option<br />
is often used for training purposes<br />
in particular."<br />
The background for the experience<br />
is a video or photo shot from the<br />
perspective of an employee at the<br />
workspace. A trainee can use this to<br />
get an overview of the entire environment<br />
without having to actually<br />
enter the workplace.<br />
"The ability to give people an authentic<br />
impression of a workplace<br />
without much effort is already enormously<br />
helpful. This effect is further<br />
enhanced by the inclusion of additional<br />
media content," says Boss.<br />
VRDirect offers a platform through<br />
which companies can access the<br />
virtual infrastructure. Any file<br />
25<br />
source ©: Rezzil, Google LLC
<strong>Smart</strong> Business Metaverse<br />
photo ©: Amazon.com<br />
photo ©: BNP Paribas<br />
Meta What?<br />
It seems like everybody is<br />
talking about the metaverse as<br />
the next big thing that's going<br />
to revolutionise our online lives.<br />
But everyone seems to have<br />
their own idea of what the<br />
metaverse is.<br />
The term originated in the<br />
cyberpunk novel Snow Crash<br />
by Neal Stephenson in 1992. In<br />
it, everyone in the world shares<br />
an ‘imaginary place’ made<br />
available to the public over a<br />
worldwide fiber-optic network<br />
and projected through virtual<br />
reality goggles.<br />
Online communities have existed since at least the mid-1980s but the<br />
metaverse could bring a whole new dimension. Imagine it as being a<br />
virtual world which incorporates augmented reality, virtual reality, 3D<br />
holographic avatars, video and other media. As the metaverse expands,<br />
it will offer a hyper-real alternative world in which people coexist.<br />
Fans of the metaverse envision its users working, playing and staying<br />
connected with friends through everything from online concerts and<br />
conferences to virtual trips around the world.<br />
Interest in pure digital ownership – and the technology that proponents<br />
believe can ensure the security of persistent virtual experiences – has<br />
spiked dramatically, with non-fungible tokens (NFTs) and cryptocurrencies<br />
making the headlines. Virtual productivity platforms are growing,<br />
too, with Facebook and Microsoft announcing new ways to collaborate<br />
online. Nike is even preparing to sell virtual sneakers and has filed<br />
patents to this effect.<br />
In a recent interview with Time magazine, John Egan, CEO of L’Atelier<br />
BNP Paribas, said, “This metaverse<br />
concept gives us the opportunity<br />
to create any universe<br />
that we’ve ever imagined.”<br />
For now, spending any part of<br />
a workday in the metaverse still<br />
seems like a far-off dream for<br />
most of the global workforce,<br />
with many remaining unconvinced.<br />
For them, the memories<br />
John Egan<br />
CEO of L’Atelier BNP Paribas of the first virtual world, Second<br />
Life, may still be too fresh.<br />
Second Life is a real-time, immersive social space for people to interact<br />
through anonymous avatars. Launched by Linden Labs in 1999, in its<br />
heyday it boasted a currency of its own, Linden Dollars, and largely<br />
financed itself through the sale of rentals for virtual properties and the<br />
income from premium memberships. In 2013, the system had around<br />
36 million registered user accounts but a series of scandals, including<br />
the rape of virtual children, caused user numbers to plummet and<br />
Second Life is now often derisively referred to as the "avatar graveyard”.<br />
26<br />
that can be included in a PowerPoint<br />
presentation can also be integrated<br />
into the VR environment. For example,<br />
graphics or videos can be used<br />
to clearly show the necessary work<br />
steps. Artificial worlds can also be<br />
generated by importing computeraided<br />
design (CAD) plans instead<br />
of real-world images. Rather than<br />
redrawing the 3D environment, the<br />
relevant data is often available from<br />
the original manufacturers and architects.<br />
Thanks to standardised<br />
interfaces, more companies are finding<br />
it easier to go down this route.<br />
Choose Your Reality<br />
Until recently, high-performance<br />
computers connected to playback<br />
devices were needed to display vivid<br />
VR experiences. Now, several manu-<br />
Windows to the<br />
Virtual World<br />
Several manufacturers<br />
offer standalone<br />
products through<br />
which VR experiences<br />
can be played<br />
back with excellent<br />
quality.<br />
facturers offer standalone products<br />
through which VR experiences can<br />
be played back with excellent quality.<br />
Besides the Oculus headset from<br />
Facebook, HTC’s Vive and Pico’s visor<br />
are particularly worth mentioning<br />
here. All of them offer technically<br />
mature and well-equipped devices<br />
for just a few hundred euros – and<br />
there are specially tailored packages<br />
for companies.<br />
Companies are benefiting from VR in<br />
a variety of ways. Automotive giant<br />
BMW, for example, used the technology<br />
to let customers participate in a<br />
Virtual Showrooms<br />
Automakers are using VR to<br />
allow customers to participate<br />
in live events without leaving<br />
their homes or offices.<br />
source ©: Actualités télécoms et high-tech, Amazon.de, Pico Interactive<br />
source ©: BMW AG, BMW M GmbH
joint event at the BMW i Motorsport<br />
Virtual Garage Experience. Regardless<br />
of pandemic constraints, attendance<br />
through the use of Pico VR<br />
headsets deeply impressed the virtual<br />
delegates.<br />
VR has also enabled telecom company<br />
Orange Polska to train over<br />
1,000 employees. The average learning<br />
time decreased from four hours<br />
to 45 minutes and effectiveness<br />
increased. Almost 70 percent of the<br />
trainees now think that traditional<br />
teaching should be replaced by VR<br />
training in the future.<br />
Shortly before Mark Zuckerberg announced<br />
a bright future for VR and<br />
renamed his company Meta, Facebook’s<br />
consumer-market Oculus<br />
headsets also expanded into the<br />
business arena. Its Horizon Workrooms<br />
app has been designed to let<br />
people work together in the same<br />
virtual room from anywhere in the<br />
world.<br />
One particularly impressive use case<br />
comes from BSH Hausgeräte, a joint<br />
home appliance and digital services<br />
venture between Bosch, Siemens<br />
and Neff, which has integrated<br />
We can now<br />
experience the<br />
use of tools with<br />
colleagues from<br />
different factories<br />
virtually.<br />
Juan Luis Cihuelo<br />
BSH coordinator<br />
source ©: BSH Hausgeräte GmbH<br />
Zuckerberg is betting big on virtual reality<br />
To the Metaverse<br />
and Beyond n By Eric Doyle<br />
Mark Zuckerberg plans to help<br />
build the ‘metaverse’, an ambitious<br />
three-dimensional world that will<br />
merge real life with a virtual reality<br />
existence in an unlimited universe<br />
of playgrounds. He predicts that the<br />
metaverse will supplant the internet<br />
with the bold promise that “you’re<br />
going to be able to do almost anything<br />
you can imagine”.<br />
As CEO of the company, he announced<br />
last October that Facebook,<br />
the umbrella company that includes<br />
the social media giant alongside<br />
Instagram and WhatsApp, will be<br />
renamed Meta to underscore the<br />
importance of the initiative. During<br />
the presentation, he outlined some<br />
of the experiences that users will be<br />
able to enjoy: competing against holograms<br />
of Olympic athletes or going<br />
to virtual concerts with your friends.<br />
In the business world, there will be<br />
mixed-reality meetings where some<br />
participants are physically present<br />
while others beam in from the metaverse<br />
as avatars, cartoon-like images<br />
of themselves.<br />
You're going to<br />
be able to do<br />
almost everything<br />
you can<br />
imagine.<br />
Mark Zuckerberg<br />
CEO of Meta/Facebook<br />
source ©: Facebook / Mark Zuckerberg<br />
The metaverse is no more than a<br />
concept at the moment and potential<br />
partners like Meta, Microsoft,<br />
Apple and Nvidia have yet to discuss<br />
plumbing issues, such as technical<br />
standards and, further down the<br />
line, how much compute power will<br />
be required and its environmental<br />
impact. There are also moral issues<br />
to be considered in the light of the<br />
recent Facebook Papers revelations<br />
about the company’s apparent reluctance<br />
to take action against bullying<br />
and misinformation on its current<br />
platform.<br />
It may be some time before the metaverse<br />
virtually becomes a reality. In<br />
the meantime, the press is likely to<br />
be overpopulated with articles discussing<br />
its possibilities and benefits,<br />
its limitations and negative impacts.<br />
That it will happen in some form or<br />
other is beyond question because the<br />
3D virtual world is too attractive and a<br />
future reality akin to USS Enterprise’s<br />
Holodeck in Star Trek is beguiling.<br />
27
<strong>Smart</strong> Business Metaverse<br />
Interview<br />
source ©: Advantech Service-IoT GmbH<br />
Intuitive Experience<br />
An interview with June Hsieh, senior<br />
B2B sales manager at HTC Vive,<br />
about the impact of VR in business<br />
environments.<br />
VR makes<br />
training larger<br />
groups during<br />
the pandemic<br />
much easier.<br />
June Hsieh<br />
HTC Vive<br />
Do you have the impression that<br />
VR technology in companies received<br />
a boost from the pandemic?<br />
Companies like VW have been using<br />
VR in training since 2016. In an<br />
environment where production<br />
processes are constantly being optimised,<br />
it is extremely difficult to<br />
teach employees new procedures<br />
under pandemic conditions. Training<br />
larger groups is, after all, hardly<br />
possible in the company. VR applications<br />
make this much easier. In<br />
our case, the significant increase in<br />
sales of the goggles already shows<br />
that companies are using the technology<br />
intensively.<br />
Are there any areas where VR<br />
works particularly well?<br />
Many customers use VR technology<br />
for training and to familiarise<br />
new employees – but there's also a<br />
lot happening in the planning area.<br />
Service providers such as Halocline<br />
make it easier for companies that<br />
have no previous experience in this<br />
area to get started.<br />
Isn't learning to use headsets and<br />
the programming process very<br />
time-consuming both for companies<br />
and employees?<br />
Over time, the application has become<br />
quite intuitive. Of course, you<br />
need some time to get used to the<br />
VR experience but those who get<br />
into it quickly, soon get to grips<br />
with it. Producing VR content has<br />
also become much easier lately.<br />
Many newcomers are surprised at<br />
how easy integration has become.<br />
virtual reality as a commonly used<br />
tool throughout its factories. VR has<br />
allowed BSH to reduce the time and<br />
costs for developing new production<br />
lines by accelerating the engineering<br />
processes.<br />
"Finding ourselves in the same virtual<br />
room with suppliers, colleagues<br />
and the production machines, we<br />
are able to review and release new<br />
designs, " explains Juan Luis Cihuelo,<br />
BSH coordinator in the Zaragoza<br />
plant in Spain.<br />
Staying Healthy<br />
During lockdown, the technology<br />
also helped to safeguard the health<br />
of staff while keeping production<br />
lines running. "We could experience<br />
the material supply and the use of<br />
tools with colleagues from different<br />
factories virtually," he adds. This<br />
large utilisation of VR tools required<br />
less effort than previous projects.<br />
"In the past, we were focused on<br />
highly sophisticated and expensive<br />
IT tools for digital factory planning<br />
and the specialists required to use<br />
these tools, like VR Caves,” says Ralf<br />
Just Another Day<br />
at the Office<br />
VR will become part<br />
of everyday life in the<br />
business environment<br />
much sooner than<br />
in private life, some<br />
experts predict.<br />
Nagel, product owner for the <strong>Industry</strong><br />
4.0 digital factory at BSH. A Cave,<br />
which stands for a Cave Automatic<br />
Virtual Environment, is an immersive<br />
VR environment where projectors<br />
are directed at between three and<br />
six of the walls of a room-sized cube.<br />
“However, to be successful in digitalisation,”<br />
he continues, “it is necessary<br />
to focus on the people, the<br />
cultural change and the scalability<br />
of the solutions. For us, this means<br />
that every engineer worldwide can<br />
use VR technology for planning and<br />
engineering in daily work and benefit<br />
from its integration into our digital<br />
factory backbone and the global<br />
digital collaboration."<br />
There is an increasing number of<br />
indicators that VR technologies will<br />
become part of everyday life in the<br />
business environment more quickly<br />
than in private life. It makes work<br />
easier, saves money and creates new<br />
opportunities for collaboration. It<br />
also helps people across continents<br />
to work together more efficiently<br />
and more quickly.<br />
source ©: Meta<br />
28
E-Mobility<br />
think again about<br />
vehicle ownership<br />
The wholesale electrification of<br />
transportation systems will be a<br />
key element of ongoing efforts<br />
to reduce carbon emissions and<br />
tackle the climate change challenges that<br />
our society is now facing. It will also be<br />
pivotal in addressing the air pollution issues<br />
that are currently being experienced in densely<br />
populated urban areas.<br />
Electric vehicle (EV) sales have reached new<br />
heights over the course of the last 18 months, with<br />
EU data showing that they now represent approximately<br />
11% of all new car registrations. It is clear that<br />
the numbers are going to increase still further in the<br />
coming years, with the EU’s target for EVs to constitute<br />
well over half of vehicle registrations in member<br />
states by the end of this decade. Likewise, major investment<br />
in rail networks has resulted in a migration<br />
away from diesel-based trains to ones that rely on<br />
electrical propulsion - with clear environmental and<br />
public health benefits consequently being derived.<br />
The deployment of extensive charging stations is<br />
essential if continued uptake of EVs is going to be<br />
encouraged - and this will be an integral part of<br />
many of the smart city projects that are currently<br />
being planned across Europe. Much of the earlier<br />
equipment that had initially been used is now in the<br />
process of being replaced by higher voltage rapid<br />
chargers. These will offer greater convenience to<br />
vehicle drivers, as the recharge times supported are<br />
cut from several hours to less than 30 minutes, closer<br />
to the length of a fuel-pump visit. At the same time,<br />
high-power wallbox charging units are starting to<br />
be installed within the residential environment.<br />
Raising the voltage levels of EV powertrains will be<br />
another important step in driving more widespread<br />
EVs are the<br />
fastest growing<br />
subsegment in<br />
the automotive<br />
IC market.<br />
Gilles Beltran<br />
President Avnet Silica<br />
adoption of these vehicles. This will<br />
mean that efficiency figures can be<br />
boosted and their overall weight reduced.<br />
The key benefit of all this will<br />
be that far longer distances may be<br />
covered between recharges, giving the<br />
public greater confidence that buying an<br />
EV is the right decision.<br />
The EV era may also lead to established views<br />
on vehicle ownership, which have remained the<br />
same for over a century, being re-evaluated. Instead<br />
of simply buying cars, mobility-as-a-service business<br />
models might start to be explored. Connection of<br />
EVs to the electrical distribution network will also<br />
present homeowners with financial incentives to<br />
participate in grid-balancing activities.<br />
This large-scale transport electrification is bringing<br />
unprecedented demands for semiconductor components.<br />
EVs are the fastest growing subsegment<br />
in the automotive IC market, increasing by approximately<br />
68 percent during 2021 with a further 25 percent<br />
growth expected in <strong>2022</strong> * . EV powertrains and<br />
rail infrastructure will require access to advanced<br />
semiconductor technology, including the latest<br />
wide bandgap discretes. As well as state-of-the-art<br />
power devices, commercial fast charging stations<br />
will mandate next generation data connectivity and<br />
superior security solutions. Robust and responsive<br />
supply chains must therefore be in place, so as to<br />
ensure that shipment schedules can be maintained.<br />
The engineering team at Avnet Silica has a deep<br />
understanding of the dynamics involved in transport<br />
electrification and their logistical implications.<br />
This means that our operations are fully prepared to<br />
ramp up in procurement activity that is on the horizon.<br />
* Avnet TAM analysis<br />
29
<strong>Smart</strong> Business IoT & Regulation<br />
IoT & Regulation<br />
The Future of IoT<br />
The Internet of Things (IoT) is poised<br />
to disrupt and transform many<br />
industries. While IoT is still in its<br />
infancy, businesses are already<br />
experiencing improved operational<br />
efficiencies, productivity growth,<br />
cost reductions and new revenue<br />
generation opportunities. These<br />
gains are likely to increase and scale<br />
across the economy as IoT technological<br />
maturity and adoption increaes.<br />
n By Gordon Feller*<br />
Emerging technologies, such as<br />
IoT, can take ten or more years<br />
to reach market saturation<br />
from incubation. The US federal<br />
government stimulates this journey<br />
through targeted investments<br />
in research and development (R&D)<br />
and technology transfer as part of its<br />
Lab-to-Market process. In 2020, the<br />
US government invested $140 billion<br />
in a broad range of federally-funded<br />
R&D programmes, including emerging<br />
technologies. Approximately<br />
$50 billion of this total was directed<br />
towards nearly 300 government<br />
owned, government operated laboratories<br />
across the country. Some of<br />
these investments will likely yield<br />
extraordinary, long‐term, economic<br />
impacts when they are transferred<br />
to and used by industry.<br />
IoT is now ranked as strategically<br />
important by each of the major<br />
US federal agencies that focus on<br />
increasing competitiveness, economic<br />
prosperity, and national<br />
security.<br />
For IoT to realise its potential and<br />
achieve these benefits, a robust<br />
and secure technology infrastructure<br />
is required. This requires addressing<br />
two fundamental questions<br />
to ensure that resources are<br />
effectively allocated:<br />
• Where are the technology infrastructure<br />
gaps that prevent IoT<br />
technologies from being more<br />
widely adopted?<br />
• Where should the US federal<br />
government be directing resources<br />
and investments to<br />
close these gaps?<br />
30<br />
*Gordon Feller has been reporting on emerging tech trends for over 40 years. He served as Global Fellow at the Smithsonian Institution<br />
and founded the non-profit Meeting of the Minds. He’s been awarded several fellowships, including the Abe Fellowship.
NIST Steps Up<br />
The National Institute of Standards<br />
and Technology (NIST) is a nonregulatory<br />
agency within the US<br />
Department of Commerce. Its role<br />
is to promote technology innovation,<br />
competitiveness and the<br />
commercialisation of federallysponsored<br />
research across all government<br />
agencies. NIST is central<br />
to the Lab-to-Market efforts, serving<br />
as the coordinator of the President's<br />
Management Agenda Cross<br />
Agency Priority Goal 14 (Lab-to-<br />
Market) and co-chairing a National<br />
Science and Technology Council<br />
(NSTC).<br />
"Given the strategic importance of<br />
IoT, and in support of the Lab-to-<br />
Market initiative, NIST felt that it<br />
needed to better understand the<br />
source ©: National Science Foundation<br />
NIST wants to<br />
better understand<br />
the current<br />
state of IoT<br />
research efforts.<br />
Sethuraman<br />
Panchanathan<br />
Director of National Science<br />
Foundation<br />
current state of IoT research efforts,"<br />
says Sethuraman Panchanathan,<br />
Director of National Science<br />
Foundation and co-chair of NTSC's<br />
Committee on Science and Technology<br />
Enterprise. To answer the<br />
two fundamental questions, he<br />
says, NIST has funded a research<br />
grant aimed at four key goals:<br />
• To better understand the current<br />
state of IoT research efforts.<br />
• To assess the top technology infrastructure<br />
gaps.<br />
• To quantify the benefits of closing<br />
those gaps.<br />
• To identify where future federal<br />
research investments should be<br />
made, whether it be in targeted<br />
research investments, stimulating<br />
private sector investment<br />
incentives, or other methods.<br />
This new in-depth analysis is already<br />
helping NIST to address<br />
some of the pressing IoT-related<br />
challenges by becoming better<br />
informed about the necessary<br />
31
<strong>Smart</strong> Business IoT & Regulation<br />
steps, future programmes, and the<br />
smart initiatives and investments<br />
which can support long-term economic<br />
outcomes.<br />
A California-based company,<br />
Strategy of Things, was awarded<br />
the NIST grant to conduct this research<br />
study. The research team<br />
is examining IoT opportunities in<br />
ten key industries, which together<br />
represent a significant portion of<br />
the US economy:<br />
Agriculture<br />
Construction<br />
Energy/Utilities<br />
Financial Services<br />
Healthcare<br />
Manufacturing<br />
Retail<br />
Public Sector<br />
• Telecommunications<br />
Transport<br />
Benson Chan, a senior partner<br />
at Strategy of Things, serves on<br />
the team of experts, assisted by a<br />
network of partners from government<br />
and the private sector, to ensure<br />
that the research project truly<br />
assists key leaders.<br />
The government<br />
wants to work<br />
on gaps in the<br />
technology<br />
infrastructure.<br />
Benson Chan<br />
senior partner at<br />
Strategy of Things<br />
Step by Step to IoT<br />
Initial findings from NIST<br />
predict that the evolution<br />
of IoT will occur in<br />
four distinct phases,<br />
each building on the<br />
infrastructure, capabilities,<br />
solution maturity<br />
and market adoption of<br />
the previous one.<br />
Chan argues that “IoT technologies<br />
bring enormous disruptive<br />
and beneficial impacts to national<br />
security, economic prosperity,<br />
human safety and well-being.<br />
But a number of technology infrastructure<br />
barriers stand in the<br />
way”. Because of this, he concludes<br />
that “while a number of<br />
established and start-up companies<br />
are developing IoT solutions,<br />
the federal government<br />
source ©: Benson Chan / Private Photo<br />
wants to work on the technology<br />
infrastructure gaps that industry<br />
is looking at. These include those<br />
that are not yet market ready, as<br />
well as those that no one company<br />
has the interest or resources<br />
to develop.”<br />
IoT’s Development Phases<br />
While the research is ongoing and<br />
won’t be completed until early<br />
<strong>2022</strong>, initial findings predict that<br />
the evolution of IoT will occur<br />
in four distinct phases (see Figure<br />
One). Each successive stage<br />
builds on the infrastructure, capabilities,<br />
solution maturity and<br />
market adoption of the previous<br />
one.<br />
Today’s best-of-breed IoT applications<br />
are largely point solutions<br />
that address operational<br />
inefficiencies and productivity.<br />
As underlying technologies mature<br />
and as customer acceptance<br />
grows, future IoT applications are<br />
becoming increasingly more sophisticated.<br />
They are being tightly<br />
integrated with operations and<br />
The IoT Journey: Operational Efficiency<br />
Full Autonomy<br />
Sensorization<br />
Connected Devices<br />
Vendor Ecosystems<br />
Sensor / Actuator Densif ication<br />
Massively connected devices and system of systems<br />
<strong>Industry</strong> and extended ecosystems<br />
Analytics / Machine Learning<br />
Artificial Intelligence<br />
Ambient Intelligence<br />
Ubiquitous connectivity and computing<br />
New Business and Operation Models<br />
Policies and regulations<br />
Secure and Private<br />
Trusted<br />
Ethical<br />
source ©: Strategy of Things<br />
32
The IoT Journey: Operational Efficiency<br />
Full Autonomy<br />
Edge Devices and Gateways – Processing capability, power efficiency, power management<br />
Distributed architectures – edge, mobile edge, cloud; interoperable system of systems<br />
Artifical and ambient Intelligence – autonomous intelligence, distributed collaborative<br />
intelligence<br />
Trust Architectures and Models (security, privacy, distributed ledger technology)<br />
Communications and networks at scale<br />
(stability, availability, reliability, context and date aware, etc.)<br />
Data Models, Marketplaces, Ecosystems<br />
Ethical algorithms and governance<br />
Interoperability and standards<br />
source ©: Strategy of Things<br />
information technology systems,<br />
and with each other. In short,<br />
these future IoT applications will<br />
become part of a larger, automated<br />
system of systems. The<br />
emerging solutions are focused<br />
on enabling fully-automated operations<br />
across industry ecosystems<br />
and they promise to yield<br />
transformative benefits that can<br />
only be envisioned today.<br />
The drivers of IoT evolution do<br />
differ at each stage of the evolutionary<br />
process. For instance, today’s<br />
IoT applications use a small<br />
number of sensors. The data collected<br />
from these sensors is aggregated<br />
and analysed largely<br />
through machine learning. IoT<br />
vendors expand the functionality<br />
and utility of their solutions by<br />
building and operating their own<br />
ecosystems to create an end-toend<br />
system.<br />
IoT evolution is being driven by<br />
technological advancements, interoperability<br />
across industries,<br />
government policies and regulations,<br />
and scale. Ten sensors in a<br />
factory today will soon become<br />
tens or hundreds of thousands.<br />
In these upcoming systems of<br />
systems, machine learning will be<br />
replaced by ambient intelligence,<br />
where all devices can interact with<br />
each other autonomously and intelligently.<br />
With this integration,<br />
cybersecurity evolves to a broader<br />
concept of trust which encompasses<br />
not only the integrity of<br />
the data, the connections and the<br />
devices but also the decisions, the<br />
reliability and availability, and the<br />
equity of the outcomes.<br />
To facilitate the future state of IoT,<br />
the research has identified some<br />
potential areas of technological<br />
research investment (see Figure<br />
Two). These were identified based<br />
on a study of the IoT accelerators<br />
shown in Figure One. While there<br />
is some research on these topics<br />
today, it is largely done independently<br />
in a few areas. A broader<br />
and more coordinated research<br />
agenda is required to accelerate<br />
the maturity and adoption of IoT<br />
within the US.<br />
Where to Invest?<br />
To enable the future<br />
state of IoT, research<br />
from NIST has highlighted<br />
a number of<br />
potential key areas<br />
for future technology<br />
research investment.<br />
IoT is a disruptive and transformational<br />
emerging technology. For it to<br />
realise its full potential, governments<br />
must understand the substantial<br />
economic, strategic and national security<br />
implications of IoT better. The<br />
significance of IoT’s development is<br />
too important to be left to organic<br />
evolution or to chance alone. The<br />
US federal government, through<br />
its R&D investments and policy development,<br />
needs to play a critical<br />
role in accelerating the maturity and<br />
adoption of IoT. The wide-ranging<br />
study process, as convened by NIST<br />
and as implemented by Strategy of<br />
Things, is already helping to bring<br />
key stakeholders together.<br />
Next Steps<br />
The next stage of this effort is being<br />
focused on offering a portfolio<br />
of opportunities for action. These<br />
moves can not only be taken by<br />
any one of a myriad of government<br />
agencies but also by a growing<br />
network of committed technology<br />
partners: private companies, universities,<br />
foundations, associations.<br />
33
<strong>Smart</strong> Business Interview: Lou Lutostanski<br />
source ©: Avnet Silica<br />
Why should someone look to a<br />
distributor like Avnet for information<br />
about IoT?<br />
Throughout our history, Avnet has<br />
been the provider of enabling technologies<br />
for OEMs of electronic<br />
devices. Supporting the Internet<br />
of Things is a natural progression<br />
of our business, and we are positioned<br />
to support this transformation<br />
of delivering insights through<br />
connected devices. We recognise<br />
that our OEM customers who build<br />
“The Things” in “IoT” (the Internet<br />
of Things”) will face significant skill<br />
and resource challenges as market<br />
demands are requiring them to add<br />
cloud-based features and connected<br />
experiences to their traditional<br />
products. IoT implementations are<br />
complex and span many different<br />
disciplines that require a significant<br />
number of software skills that were<br />
not needed in the past. Recognising<br />
this gap, Avnet has invested<br />
significant resources in acquiring<br />
and developing IoT Software capabilities<br />
that can help our OEM<br />
customers create these connected<br />
experiences using the principles of<br />
We're trying<br />
to build<br />
security<br />
options into<br />
IoTConnect,<br />
so implementing<br />
the<br />
desired level<br />
of security is<br />
as easy as<br />
checking a<br />
box to order<br />
fries with<br />
your burger.<br />
Lou Lutostanski<br />
Vice President for IoT<br />
at Avnet<br />
IoT. We are prepared to support IoT,<br />
and over the past three years, we<br />
have built a solid practice and added<br />
over 700 IoT and Cloud software<br />
developers to an already significant<br />
number of hardware engineers.<br />
And we will continue to evolve so<br />
that we maintain our position as a<br />
significant technology enablement<br />
partner to our customers.<br />
Seems to me that every time<br />
someone does a new IoT project<br />
they reinvent the wheel. Is that really<br />
necessary?<br />
No, it is not. While there will always<br />
be some level of customisation in<br />
bespoke IoT applications, many<br />
companies continue to spend the<br />
majority of their time and money<br />
building and maintaining their<br />
own IoT platform using open<br />
source or Hyperscale Cloud IoT<br />
Services. This significantly extends<br />
their time to market and robs them<br />
of the resources that would be<br />
better spent on providing differentiated<br />
value in the way of their<br />
applications. It also creates significant<br />
overhead to maintain the IoT<br />
platform, which in the end, their<br />
customers will pay for.<br />
Other companies hire system integrators<br />
to build a custom IoT platform.<br />
Again, it delays time to market,<br />
incurs great expense, and locks<br />
them to one company (the SI) who<br />
they will be reliant on for the lifetime<br />
of the application as their IoT<br />
platform must be maintained into<br />
perpetuity.<br />
Spending time building or having<br />
someone else build an IoT platform<br />
for companies that create value<br />
through applications and IoT implementations,<br />
is a waste of time and<br />
money. And it adds zero value to<br />
their end customer.<br />
This is the number one reason why<br />
IoT is not scaling, and in turn, not<br />
reaching the forecast in connections<br />
predicted several years ago.<br />
Talking of ecosystems, you once<br />
criticised what you called 'ecosystem<br />
mass confusion'. How should<br />
customers go about selecting an<br />
ecosystem?<br />
Ask yourself, what would be the<br />
state of the mobile phone industry<br />
34
Interview<br />
Making<br />
‘Things’ Easier<br />
The world of IoT is changing fast and the number<br />
of vendors and solutions are legion. Finding the right<br />
supplier can be tricky, says Lou Lutostanski,<br />
vice president for the Internet of Things at Avnet.<br />
He was named IoT Leader of the Year at Industrial IoT<br />
World in 2019. Lutostanski talked with <strong>Smart</strong> <strong>Industry</strong><br />
editor Tim Cole about the future of IoT.<br />
n By Tim Cole<br />
potential return on their investment.<br />
And in the case of IoT, the<br />
higher the potential ROI, the richer<br />
the applications, AI algorithms, and<br />
hardware purpose built for the solution.<br />
The bottom line is, customers today<br />
should look for an ecosystem that<br />
can invest the most in research and<br />
development and yield the optimal<br />
features because they integrate<br />
into an IoT platform that is based<br />
on HyperScale Cloud IoT Services<br />
that can be used horizontally across<br />
many or all IoT solutions. In this<br />
way, the application that they buy<br />
will not require them to bear a part<br />
of the substantial additional cost<br />
of maintaining the platform. That<br />
cost will be born by the thousands<br />
and tens of thousands of customers<br />
that buy various applications built<br />
on that IoT platform. Additionally,<br />
it will prevent lock-in of one or several<br />
vendors and give them the<br />
if there were hundreds of operating<br />
systems rather than the few<br />
available today. What would be<br />
the quality and usefulness of user<br />
applications if every manufacturer<br />
wrote their own operating system?<br />
Fortunately, this industry gravitated<br />
towards just two OS providers,<br />
which has enabled a massive<br />
ecosystem supporting developers<br />
and markets for applications.<br />
In comparison, ecosystems for IoT<br />
developers and users are not at<br />
this level of maturity, and there is<br />
a lot of confusion around identifying<br />
the ecosystem that is going to<br />
provide the solid foundation for<br />
this industry.<br />
IoT ecosystems form around IoT<br />
platforms. These platforms provide<br />
the rules and structure for the<br />
various partners to integrate their<br />
products and services in a manner<br />
that is compatible with all other<br />
partners required for a successful<br />
IoT implementation.<br />
Partners who add value within any<br />
ecosystem are attracted by the<br />
popularity of a platform. The fewer<br />
platforms available, the higher the<br />
Build & Deploy<br />
IoTConnect Platform is a smart<br />
IoT platform that<br />
helps boost efficiency,<br />
manage assets and<br />
adopt innovation.<br />
source ©: Avnet<br />
BACnet<br />
IoT Portal<br />
Dashboards<br />
Rule Engine<br />
Analytics on<br />
Gateway<br />
CoAP<br />
Command Execution<br />
SMS<br />
SDK<br />
MQTTS<br />
Protocol<br />
Alerts &<br />
Notification<br />
Push Notification<br />
HTTPS<br />
Email<br />
Data<br />
Engineering<br />
Conection<br />
Bridge<br />
SAP HANA<br />
WS<br />
SAP BI<br />
Machine Learning<br />
Data Streaming<br />
Data Analysis<br />
Salesforce<br />
ERP<br />
AMQP<br />
CAN bus<br />
35
<strong>Smart</strong> Business Interview: Lou Lutostanski<br />
Getting Started<br />
maximum number of vendor choices<br />
for their IoT implementation.<br />
Tell me more about Avnet IoTConnect<br />
which seems to be an interesting<br />
approach.<br />
Avnet’s IoTConnect is an IoT platform<br />
built on Microsoft Azure microservices.<br />
Our microservices architecture<br />
enables us to adapt to<br />
the evolving needs of our users and<br />
developers, and we view Microsoft<br />
as one of two hyperscale cloud providers<br />
who can support Avnet for<br />
the long term. We believe alternative<br />
platform architectures built on<br />
open-source technologies are too<br />
complex to maintain and become<br />
stagnant shortly after their release.<br />
But building from the established<br />
Microsoft Azure ecosystem has provided<br />
a solid foundation.<br />
Based on our deep and long-term<br />
relationships with our semiconductor<br />
suppliers and OEM customers<br />
and our growing capabilities<br />
in cloud, IoT, AI, security, and application<br />
software, we believe our<br />
IoTConnect Platform can serve as<br />
an enabler to allow for simple, fast,<br />
and secure IoT implementations.<br />
And if we are successful in getting<br />
IoTConnect adoption as one of the<br />
two or three standard Horizontal<br />
IoT Platforms, then the scale that<br />
the industry has been expecting<br />
and is now demanding can become<br />
a reality.<br />
It would have been much easier<br />
for Avnet to help our customers<br />
with their IoT implementations,<br />
It's Official!<br />
The W3C has declared<br />
the WoT Architecture<br />
and the WoT<br />
Thing Description to<br />
be official recommendations<br />
for the<br />
standardisation of IoT<br />
applications.<br />
if there were already one or two<br />
established platforms out there.<br />
But there were not. And as such,<br />
the complexity and risk associated<br />
with IoT discouraged our customers<br />
from pursuing strategies that could<br />
create substantial growth in device<br />
counts that would have in turn fueled<br />
growth for our business. The<br />
lack of an established IoT platform<br />
also forced us to help customers<br />
create hardware solutions with<br />
limited use as they were bespoke<br />
to only the IoT platform they were<br />
designed for.<br />
source ©: Avnet<br />
Azure Sphere<br />
development kits<br />
provide everything<br />
you need to begin<br />
prototyping and<br />
developing Azure<br />
Sphere applications.<br />
Sounds like IoTConnect is offering<br />
a type of Plug and Play for IoT.<br />
Plug and Play is a term that I first<br />
heard about in the PC industry.<br />
It applied to PC peripherals that<br />
could plug directly into a PC without<br />
the requirement of the user<br />
being forced to run software programmes<br />
to install drivers.<br />
Plug and Play in the IoT world is<br />
exponentially more complex. The<br />
number of things, software elements,<br />
and connectivity methods<br />
source ©: W3C<br />
36
used to create IoT solutions are infinite.<br />
So creating rules for how these<br />
things interact with each other in<br />
the way of the platform, and having<br />
the software and hardware skills<br />
to assist those connections, is what<br />
makes Avnet the ideal entity to bring<br />
the physical and virtual worlds, the<br />
OT and IT worlds, together.<br />
We believe that Avnet will succeed<br />
while other companies, some much<br />
bigger than Avnet, have failed because<br />
they did not have a deep understanding<br />
of all the parts of IoT.<br />
People with device or connectivity<br />
solutions did not understand the<br />
cloud and above. And the cloud<br />
people lacked the deep embedded<br />
device experience to create a scalable<br />
means for rapidly onboarding<br />
an infinite number of “Things”.<br />
source ©: Informa PLC, Jeremy Coward<br />
You advise bringing order to IoT.<br />
What do you mean by that?<br />
It means developing software rules<br />
that allow companies with many<br />
different types of hardware and<br />
software products and services to<br />
participate in successful IoT implementations,<br />
without having to<br />
understand the complexities of all<br />
the technologies required to produce<br />
them. IoTConnect defines<br />
those software rules and provides<br />
a mechanism to manage those<br />
devices, integrate third party software,<br />
and integrate applications<br />
and AI in a manner that delivers<br />
simple, fast, and secure IoT implementations.<br />
It allows OEMs to deliver<br />
rich features and user experiences<br />
around their products and the<br />
opportunity to create new services<br />
to deliver revenue beyond just the<br />
physical hardware.<br />
Are IoT solution providers really<br />
addressing the security problem<br />
in an adequate fashion?<br />
The majority are not. Security is extremely<br />
complex. And with many<br />
companies building their own IoT<br />
platforms or paying someone to<br />
build it for them, budgets are usually<br />
blown before the complexities<br />
of security can be addressed.<br />
I would make two comments about<br />
IoT security.<br />
• People who are serious about IoT<br />
will never deploy at scale without<br />
some level of security. The financial<br />
liabilities and the potential<br />
damage to their brand are just<br />
too significant.<br />
• For those that deploy without security<br />
by design that get hacked,<br />
the only fix is to start over. (Rip &<br />
Replace).<br />
Avnet has built varying levels of<br />
securities into IoTConnect. And we<br />
are working with third party security<br />
and identity providers to integrate<br />
their IP into IoTConnect to facilitate<br />
the deployment of security<br />
after the fact. So one can preclude<br />
security through small or test deployments<br />
and implement security<br />
at a later date. Avnet’s goal through<br />
IoTConnect is making adding security<br />
to your IoT implantation as easy<br />
as adding fries to your burger order.<br />
How do you scale IoT?<br />
The industry needs to limit the<br />
number of IoT platforms to less<br />
than a handful. This will attract<br />
partners and create a vast and vibrant<br />
ecosystem. Companies need<br />
stop building, or paying someone<br />
to build their own IoT platforms<br />
and build their applications and<br />
Expert Opinion<br />
Lou Lutostanski, Vice<br />
President of IoT at<br />
Avnet, was named<br />
IIoT Leader of the<br />
Year at Industrial IoT<br />
World 2019.<br />
product experiences around one or<br />
two that have wide adoption in the<br />
industry such as the WoT Standard<br />
released by the W3C. Customers<br />
will never accept that they will have<br />
to maintain an equal number of IoT<br />
platforms to the number of applications<br />
that they deploy.<br />
How does the COVID pandemic<br />
accelerate IoT?<br />
I think there are two answers to that<br />
question. One is that most people<br />
are working from home now and<br />
we're finding they appear to be<br />
much more efficient. As such, they<br />
have much more time to think long<br />
term regarding applying IoT technology<br />
in their products or services.<br />
The other thing is that there's a<br />
whole new generation of applications<br />
that have been spawned<br />
for contact tracing, prescreening,<br />
medical monitoring, which have an<br />
urgency about them coupled with<br />
an extreme requirement for action.<br />
This has created a whole new application<br />
category, if you will, built to<br />
deal with the challenges presented<br />
by the Covid pandemic. So, I think<br />
these two factors have accelerated<br />
the deployment of IoT implementations.<br />
37
<strong>Smart</strong> Business Six Hurdles<br />
Six Hurdles<br />
Why IoT<br />
Projects Fail<br />
The number of businesses aiming to leverage IoT solutions is high but so<br />
is the failure rate. Network giant Cisco estimates that 74 percent<br />
of projects fail and the probable cause is a failure to understand<br />
the top obstacles and challenges that often derail IoT deployments.<br />
n By Bryan Witkowski<br />
38<br />
038-041 Why IoT Projects Fail-JC.indd 38 26.04.22 13:10
Increased<br />
Complexity<br />
Increased<br />
Complexity<br />
The explosion in the use of<br />
connected devices has created<br />
a rising need for organisations<br />
to harness data<br />
from them, which, in turn, is driving<br />
businesses to ramp up their<br />
IoT digitisation efforts. Market and<br />
consumer data specialist Statista<br />
reckons there are approximately<br />
21.5 billion interconnected devices<br />
in the world and many businesses<br />
– 94 percent, according to IOT<br />
Signals, a report from the Hypothesis<br />
Group and Microsoft – see<br />
this growth as an opportunity to<br />
analyse data and generate insights<br />
that reduce operational costs, enable<br />
better decision-making and<br />
drive innovation.<br />
Here are some of the most common<br />
hurdles blocking the track to<br />
successful adoption of IoT projects.<br />
Increased complexity – There<br />
can be many challenges around<br />
interoperability between networks,<br />
gateways and devices. A<br />
multi-vendor environment can<br />
include compatibility issues between<br />
different vendors’ products<br />
and systems, especially when<br />
The challenges<br />
may seem<br />
overwhelming,<br />
but there are<br />
many options<br />
available.<br />
Bryan Witkowski<br />
Head of Strategic Planning<br />
and co-founder of MachineQ<br />
source ©: MachineQ<br />
39<br />
038-041 Why IoT Projects Fail-JC.indd 39 26.04.22 13:10
<strong>Smart</strong> Business Six Hurdles<br />
Number of Internet of Things (IoT)<br />
connected devices worldwide from 2019 to 2030, by use case *<br />
30,000<br />
20,000<br />
10,000<br />
7,741<br />
<br />
<br />
<br />
<br />
8,738.8<br />
Connected Vehicles<br />
<strong>Smart</strong> Grit<br />
Consumer Internet & Media Devices<br />
Others<br />
16,436.6<br />
14,759.9<br />
13,146.3<br />
11,570.2<br />
10,065.1<br />
18,148.9<br />
19,908.4<br />
21,721.2<br />
23,570<br />
25,444.5<br />
source ©: Statista<br />
0<br />
2019 2020 * 2021 * <strong>2022</strong> * 2023 * 2024 * 2025 * 2026 * 2027 * 2028 * 2029 * 2030 *<br />
Additional Information: Worldwide; 2019 to 2020<br />
* in millions<br />
some use proprietary technology<br />
that is not based on industry standards.<br />
For example, differences in<br />
authentication and identification<br />
methods may cause access issues<br />
and the use of different protocols<br />
can limit the ability of devices and<br />
systems to ’talk to each other’ and<br />
share information. There are also<br />
challenges related to complexity<br />
of deployment, especially where<br />
there is no access to IT support and<br />
the installation is typically done by<br />
skilled workers who are not technically<br />
savvy. An example of this<br />
would be plumbers doing a water<br />
meter installation.<br />
Limitations to Scale – As IoT<br />
networks grow, some of the challenges<br />
above become even more<br />
pronounced because of additional<br />
devices and systems. As a result,<br />
What are They Doing?<br />
The single largest use<br />
case in terms of number<br />
of Internet of Things<br />
(IoT) connected devices<br />
is consumer internet<br />
and media devices,<br />
accounting for a third<br />
of all devices worldwide<br />
in 2030. The other two<br />
largest use cases are<br />
smart grid (e.g. smart<br />
meters) and connected<br />
vehicles.<br />
the solutions created in one context<br />
may not work well in another,<br />
which could delay or stop an enterprise<br />
IoT project.<br />
Talent Shortages – Similar to the<br />
current IT talent shortage, there is<br />
a lack of available IoT experts to fill<br />
needed positions. This can affect<br />
a range of industries, such as food<br />
services and hospitality, that are<br />
looking to embrace IoT. According<br />
to research from Inmarsat, 46<br />
percent of organisations stated<br />
that skills shortages are the most<br />
significant barrier to their deployments.<br />
A lack of qualified, skilled<br />
talent can affect the ability to roll<br />
out new deployments or have the<br />
proper quality controls in place to<br />
take IoT from the proof-of-concept<br />
(POC) phase to full production.<br />
Security Vulnerabilities – While<br />
IoT devices are great at doing what<br />
they are designed and built for,<br />
they typically have limited computing<br />
resources, which means<br />
they often lack built-in security<br />
features – or they are connected<br />
to the internal IT infrastructure,<br />
which poses additional risks to security.<br />
The resultant expansion of the attack<br />
surface and opportunities for<br />
cybercriminals often stems from<br />
the fact that many organisations<br />
don’t see IoT devices as a highsecurity<br />
threat, so they are not as<br />
diligent with passwords or encryption.<br />
In addition, IoT devices often<br />
don’t receive security patches as<br />
quickly as other mainstream devices,<br />
such as laptops and smartphones.<br />
All of this can lead to more<br />
IoT-related cyberattacks, as in the<br />
40<br />
038-041 Why IoT Projects Fail-JC.indd 40 26.04.22 13:10
case of a supplier of IoT cameras<br />
that discovered a software vulnerability<br />
which exposed a range of<br />
industrial devices to potential cyberattack.<br />
Limited reach – Many industries<br />
that want to use IoT solutions face<br />
the challenges of remote sites located<br />
in far-reaching geographies<br />
and areas that are hard to reach.<br />
For example, an oil rig in the middle<br />
of the ocean or a pipeline that<br />
stretches for hundreds of miles<br />
across the countryside can make<br />
it difficult to get consistent, reliable<br />
connectivity to support the<br />
transfer of data from numerous<br />
sensors out to the cloud or to endapplications.<br />
Power Consumption – Using hundreds<br />
or thousands of sensors also<br />
creates a concern that can impact<br />
cost – battery life. It’s important to<br />
explore how long a battery will last<br />
in an IoT device because the time<br />
and cost of replacement might be<br />
just as expensive as the original<br />
deployment.<br />
As a result, this can have a significant<br />
impact on the total cost of<br />
ownership (TCO) of the project<br />
– sometimes sufficient to affect<br />
overall cost-feasibility. This TCO<br />
issue can leave an organisation<br />
stuck in the POC phase, unable to<br />
move on to production.<br />
While these challenges may seem<br />
overwhelming, there are many<br />
Challenges to using IoT more<br />
Still in Progress<br />
Complexity/Technical<br />
Security<br />
Complexity/Technical<br />
Lack of Budget/Staff<br />
Complexity/Technical<br />
Lack of Budget/Staff<br />
Lack of Knowledge<br />
Security<br />
Compliance<br />
Lack of Knowledge<br />
Complexity/Technical<br />
Lack of Knowledge<br />
Leadership/Team Challenges<br />
Security<br />
Haven’t Found Right Solution<br />
options available for enterprises.<br />
Technologies such as low-power,<br />
wide-area networks (LPWANs) can<br />
provide the simplicity, scale, reach,<br />
security and power needed to take<br />
many IoT projects from concept<br />
(POC) to reality (full production<br />
deployment).<br />
Still implementing our current solutions<br />
Too complex to implement because of technology demands<br />
Security risk isn’t worth it<br />
Want to work out challenges before adding/using IoT more<br />
Don't have human resources to implement & manage<br />
Too complex to implement because of business transformation needed<br />
Don't have budget<br />
Not enough training/guidance on how to deploy<br />
Concerned about consumer privacy<br />
Too many compliance/regulatory challenges<br />
Lack technical knowledge<br />
Too long to implement<br />
Don't know enough<br />
No buy - in from senior leadership<br />
Unwilling to store data on public cloud<br />
No solution that meets our needs<br />
Where IoT Breaks Down<br />
A third of companies are still<br />
implementing their current<br />
solution; 27 percent say the<br />
technological demands are<br />
prohibitive; and another 27<br />
percent feel the security risk<br />
simply isn’t worth it.<br />
Low Power<br />
Consumption<br />
One of the key competitive<br />
advantages of<br />
LoRaWan technology<br />
is the energy efficiency<br />
of the equipment.<br />
29%<br />
27%<br />
27%<br />
26%<br />
25%<br />
24%<br />
23%<br />
22%<br />
22%<br />
21%<br />
21%<br />
20%<br />
20%<br />
19%<br />
18%<br />
17%<br />
Vendors Share the Same<br />
Environment<br />
The LoRaWAN industry standards,<br />
for example, mean that different<br />
vendors’ products can offer compatibility<br />
to allow them to easily<br />
exist in the same environment.<br />
Finally, the automated nature of<br />
these solutions allows organisations<br />
to free up employees’ time to<br />
focus on activities that positively<br />
impact sales and customer service.<br />
By having a better awareness and<br />
understanding of these key challenges,<br />
enterprises can confidently<br />
take the important first step towards<br />
solving them and making<br />
large-scale IoT deployments a reality.<br />
source ©: Hypothesis Group, Microsoft<br />
LoRaWan Differentiators & Benefits<br />
Public and<br />
Private<br />
Deployment<br />
Options<br />
Firmware<br />
Updates<br />
Over-the-Air<br />
Geolocation<br />
Bi-Directional<br />
Security<br />
10+ Year<br />
Battery Life<br />
Coverage in<br />
Rural and<br />
Non-Cellular<br />
Area<br />
Deep<br />
Penetration<br />
(Concrete,<br />
Ground, Steel)<br />
source ©: BrightTALK<br />
41<br />
038-041 Why IoT Projects Fail-JC.indd 41 26.04.22 13:10
<strong>Smart</strong> Business Industrial IoT<br />
42
Industrial IoT<br />
How to Eat<br />
the IIoT Elephant<br />
Learn, through two useful examples, how to start simple and<br />
move to more complex Industrial IoT implementations.<br />
n By Göran Appelquist*<br />
Moving to Industrial IoT<br />
can be a challenge.<br />
Through working on<br />
many customer projects<br />
over a number of years at<br />
Crosser, we have learnt that a<br />
key success factor is to start with<br />
small projects that are quick and<br />
easy to implement before gradually<br />
building up to the more advanced<br />
and complex use cases.<br />
That is, always eat the elephant<br />
in pieces, don’t try to swallow it<br />
whole.<br />
In most cases it is possible to find<br />
small and simple projects that are<br />
good starting points requiring<br />
a low effort to implement while<br />
returning value quickly. With the<br />
right tools it is easy to start simple<br />
and then add more advanced features<br />
over time.<br />
Simple Beginnings<br />
Here are some simple but useful<br />
projects, showing how they can<br />
be implemented with Crosser’s<br />
Edge Streaming Analytics. The<br />
How to get There<br />
From Here<br />
Data mismatch is a<br />
common problem in<br />
IoT. Therefore, data<br />
transformation and<br />
harmonisation play a<br />
major role.<br />
Crosser system provides a large<br />
library of pre-made building<br />
blocks (modules) that implement<br />
common functionalities for these<br />
types of use cases. By using these<br />
modules, it is easy to get started<br />
by combining modules into applications<br />
using a graphical drag<br />
and drop editor. With the interactive<br />
debugging capabilities, each<br />
application can be verified before<br />
installing them for continuous<br />
operation on Crosser Nodes that<br />
have been installed near the<br />
source ©: Crosser Technologies<br />
*Göran Appelquist is CTO at Crosser, an IIoT specialist based in Sweden and in Munich, Germany.<br />
43
<strong>Smart</strong> Business Industrial IoT<br />
systems with which they will interact.<br />
source ©: Crosser Technologies<br />
System Availability<br />
Monitoring system availability is<br />
a very common requirement. This<br />
kind of application can be created<br />
by starting with a time trigger<br />
that will fire the application<br />
once every minute, or whatever<br />
time period makes sense. A call is<br />
made to the system to be monitored,<br />
for example a programmable<br />
logic controller (PLC) or a representational<br />
state transfer (REST)<br />
endpoint. If the request fails, a<br />
notification is sent to someone<br />
using a text messaging service.<br />
Here a Modbus PLC is being<br />
polled every minute and, if no<br />
response is detected, text messages<br />
will be sent to the managers’<br />
mobile phones using the<br />
Twilio messaging service. This is,<br />
of course, a very basic application<br />
but, if failures are not expected<br />
too often, it could still be useful.<br />
The same concept can be used<br />
with any system that accepts an<br />
external request. For example, if<br />
an HTTP endpoint has to be monitored,<br />
the Modbus module can<br />
easily be replaced with an HTTP<br />
request module.<br />
When the monitor is up and running,<br />
ways to improve it can be<br />
considered. One obvious problem<br />
is that a message will be triggered<br />
every minute if the PLC stays in an<br />
unresponsive state – which could<br />
Always eat the<br />
elephant in<br />
pieces - don't<br />
try to swallow it<br />
whole!<br />
Göran Appelquist<br />
Crosser<br />
be quite annoying. It’s easily fixed<br />
just by adding a Report By Exception<br />
module so that a message is<br />
sent only when the PLC initially<br />
becomes unresponsive.<br />
If the PLC is a bit shaky, flipping<br />
back and forth between online<br />
and offline, the monitor may once<br />
again send more messages than<br />
necessary. Another easy fix is to<br />
add a Throttle module to make<br />
sure only one message is sent per<br />
hour (or whatever duration is suitable).<br />
Finally, it might be desirable to<br />
get availability statistics captured<br />
over a long timespan. Here, the<br />
Time Counter module can be<br />
used to take the same input as<br />
before to provide a summary of<br />
the times spent in each state over<br />
a specified period. The results can<br />
be sent as an uptime report once<br />
per day.<br />
The new generation<br />
integration platform<br />
allows you to integrate<br />
any device or machine<br />
data and any data<br />
source with smart<br />
workflows, events and<br />
triggers in real time.<br />
The project started with something<br />
really simple, but still<br />
useful, and then it was gradually<br />
improved to finally arrive at<br />
something that now has more<br />
functionality. The development<br />
team can decide how much further<br />
to take it and at what pace.<br />
Integrity Checking<br />
Data integrity is a broad concept<br />
with many possible applications,<br />
such as checking that values are<br />
within reasonable limits, counters<br />
are constantly incremented, or<br />
that data is updated at a certain<br />
rate.<br />
The latter case will be used here,<br />
checking that sensor data is updated<br />
at the expected rate. For<br />
this example, a subscription must<br />
be set up against an open platform<br />
communications unified<br />
architecture (OPC-UA) server that<br />
source ©: Crosser Technologies<br />
44
Guidelines<br />
The examples given share some characteristics<br />
that can serve as general<br />
guidelines when trying to identify other<br />
projects that are good starting points<br />
for edge analytics:<br />
•<br />
Find use cases that are add-ons<br />
to the existing operation, that is,<br />
ensure that neither the input nor the<br />
output systems rely on the operation<br />
of the business critical application<br />
to which they are attached.<br />
•<br />
Find uses that add value when they<br />
work but won’t have a major negative<br />
impact if they don’t.<br />
•<br />
For the first implementation, try<br />
to scale down the problem to an<br />
absolute minimum, while still adding<br />
value (minimum viable product).<br />
Then incrementally add features until<br />
the final goal has been reached.<br />
•<br />
Build an application that solves<br />
the problem when everything<br />
works normally, known as a ‘happy<br />
path’ implementation. Then add<br />
additional logic later to cover situations<br />
where things don’t work as<br />
expected.<br />
will then push back changes in<br />
values and these results will be<br />
checked every second by using a<br />
Timeout module.<br />
The Timeout module has to be<br />
set to check there are no changes<br />
within periods of 70 seconds rather<br />
than 60 seconds, chosen to offer<br />
a margin for small deviations<br />
in update frequency. This module<br />
can monitor any number of sensors<br />
and, as soon as one of them<br />
fails to deliver data in time, it will<br />
indicate which sensor has failed.<br />
In this project, the application will<br />
make an HTTP request when a sensor<br />
fails, maybe calling on the enterprise<br />
resource planning (ERP) or<br />
manufacturing execution systems<br />
(MES) to trigger further actions.<br />
With this very simple flow, thousands<br />
of sensors can be monitored<br />
as long as they have the<br />
same expected data rate. If the<br />
Getting There<br />
Build integration<br />
flows with the Flow<br />
Studio using a<br />
library of modules<br />
and connectors.<br />
Add data mapping,<br />
data transformation,<br />
triggers<br />
and events to your<br />
flows with ease.<br />
sensors, or groups of sensors,<br />
have different data rates, multiple<br />
Timeout modules can be added<br />
with differing timeout settings<br />
using a filter on each to allow the<br />
relevant sensors to be selected:<br />
These two simple but realistic use<br />
cases are good starting points for<br />
introducing edge streaming analytics.<br />
It’s possible to find many<br />
alternative but equally simple examples<br />
within any organisation.<br />
source ©: Crosser Technologies<br />
45
<strong>Smart</strong> Communications Trucking & IoT<br />
Trucking & IoT<br />
Delivering<br />
a Revolution<br />
Artificial intelligence, advanced robotics and the Internet of Things<br />
are poised to spark a revolution in the automobile industry.<br />
Automated cars have grabbed the headlines in recent years but<br />
most analysts, quite reasonably, believe<br />
that freight trucks will be the first fully-automated<br />
vehicles in regular use on the roads.<br />
n By Tim Cole*<br />
46<br />
*Tim Cole is editor of <strong>Smart</strong> <strong>Industry</strong>.
The trucking industry, and the<br />
logistics that keep it running,<br />
has become fundamental to<br />
the success of supply chains,<br />
both nationally and internationally.<br />
Without those supply chains running<br />
smoothly, allowing for just-intime<br />
orders and millions of successful<br />
daily deliveries, industries of all<br />
types would grind to a halt.<br />
The Brexit situation, with Great<br />
Britain withdrawing from the European<br />
Union, is a perfect example<br />
of the kind of chaos a broken supply<br />
chain can create. In the fall of<br />
2021, cars and trucks were lining up<br />
in front of empty pumps at UK gas<br />
stations, and supermarket shelves<br />
remained barren, all for the lack<br />
of truckers. A Road Haulage Association<br />
(RHA) survey of its members<br />
estimates there is now a shortage<br />
of more than 100,000 qualified drivers<br />
in the UK. That number includes<br />
thousands of drivers from European<br />
Union (EU) member states who were<br />
previously living and working in the<br />
UK. Issues such as this highlight the<br />
importance of the trucking industry.<br />
Time is of the Essence<br />
Yet geopolitical issues such as this<br />
are far from the only challenges<br />
currently facing freight and haulage,<br />
with market demands shifting<br />
quickly and shipments growing accordingly.<br />
In America, a report by<br />
the Federal Motor Carrier Safety<br />
Administration (FMCSA) said there<br />
were approximately 493,730 trucking<br />
companies in the US alone. Even<br />
today, most of the small business<br />
owners in the US are truckers. So,<br />
as this industry grows, it becomes<br />
necessary to track several statistics<br />
in real-time. Factors like the load on<br />
the trucks, time required for loading<br />
and unloading of goods, traffic<br />
on the travel routes, or tracking the<br />
vehicles in real-time are important<br />
to the fleet managers and truck<br />
owners of the businesses.<br />
These issues have put trucking<br />
front and centre in the eyes of those<br />
seeking industry disruption, resulting<br />
in seismic changes to the way<br />
trucking works. As with so many<br />
The driver<br />
situation is<br />
about as bad<br />
as I've ever<br />
seen it in my<br />
career.<br />
Help Wanted<br />
A Road Haulage<br />
Association (RHA)<br />
survey estimates<br />
there is now a<br />
shortage of more<br />
than 100,000<br />
qualified drivers in<br />
the UK alone.<br />
Eric Fuller<br />
CEO of U.S. Xpress<br />
other key industries in transition, it’s<br />
the Internet of Things (IoT), AI, and<br />
robotics that are leading the way<br />
and providing truly remarkable solutions<br />
to ever-growing problems.<br />
IoT has connected sensors, electronic<br />
monitors, actuators, GPS receivers,<br />
RFID systems, beacons, and<br />
so on, with a network of physical<br />
devices, appliances, vehicles, and<br />
other items for data collection and<br />
communication. In transportation<br />
and trucking, it has provided several<br />
promising solutions to develop<br />
powerful new applications and systems.<br />
When an AI-driven, long-haul<br />
industry is in place, it’s not difficult<br />
to imagine the rest of the automotive<br />
industry catching up.<br />
IoT-based solutions are transforming<br />
the trucking industry in unbelievable<br />
ways. They assure better<br />
transparency, higher operational efficiency<br />
and enhanced security – ultimately<br />
increasing profit margins.<br />
Time taken to fill last HGV driver vacancy<br />
1-2 weeks<br />
2-4 weeks<br />
4-6 weeks<br />
6-8 weeks<br />
8+ weeks<br />
0% 10% 20% 30%<br />
"Not applicable" not shown<br />
source ©: Road Haulage Association source ©: Scenic Roots<br />
47
<strong>Smart</strong> Communications Trucking & IoT<br />
source ©: Intel Corporation<br />
Trucks, which have sensors connected,<br />
travel via different routes and, at<br />
various location transmission hubs,<br />
collect and send data to the decisionmakers<br />
for the insights that help in<br />
gaining better results.<br />
Here’s a closer look at ways in which<br />
IoT and AI technology is transforming<br />
the trucking industry and how<br />
the industry will benefit from justin-time<br />
trucking and logistics.<br />
Keeping Track of<br />
Truckers<br />
Electronic Logging<br />
Devices, or ELDs, are<br />
now mandatory for<br />
commercial drivers<br />
who are required to<br />
prepare hours-ofservice<br />
(HOS) records<br />
of duty status,<br />
further increasing<br />
pressure on trucking<br />
companies who<br />
need to hire more<br />
drivers to comply.<br />
Loads of Problems<br />
Data produced by<br />
hundreds of sensors<br />
on commercial trucks<br />
is fused together in<br />
real-time to get meaningful<br />
information that<br />
optimises safety, fuel<br />
economy, and maintenance<br />
of the vehicle.<br />
Intelligent Data Driving Performance<br />
Feb16, 2016 - Dec 18, 2017<br />
Phase 1<br />
Completed<br />
Dec 18, 2017 - Dec 16, 2019<br />
Phase 2<br />
After Dec 16, 2019<br />
Phase 3<br />
A Phased Approach<br />
As the ELD rule is implemented,<br />
motor carriers will be allowed<br />
time to transition to full<br />
adoption of ELDs. This table<br />
illustrates which recording<br />
methods are acceptable during<br />
each phase implementation.<br />
ever, as the robot systems become<br />
more skilled on their routes, a future<br />
of completely driverless fleets<br />
of trucks is easily foreseeable.<br />
Fuel, insurance and drivers’ wages<br />
are obviously the trucking industry’s<br />
key expenses. By tracking the<br />
locations, driving habits and speed<br />
of the trucks in a fleet, expenses can<br />
be managed more successfully and<br />
efficiently. A combination of Big<br />
Data, AI, and IoT devices will make<br />
Awareness and Transition Phase<br />
During this time, carriers and drivers subject to the rule could<br />
prepare to comply and voluntarily use ELDs.<br />
Carriers and drivers subject to the rule could use any of<br />
the following for records of duty status (RODS):<br />
Paper logs | Logging software | AOBRDs<br />
ELDs that are self-certified and registered with FMCSA<br />
Phased-In Compliance Phase<br />
The two-year period from the Compliance Date to the<br />
Full Compliance Phase. Carriers and drivers subject to<br />
the rule can use:<br />
AOBRDs installed and in-use prior to December 18, 2017<br />
ELDs that are self-certified and registered with FMCSA<br />
Full Compliance Phase<br />
All drivers and carriers subject to the rule must use<br />
self-certified ELDs that are registered with FMCSA.<br />
ELD<br />
AOBRD<br />
Logging<br />
Software<br />
Paper<br />
Phase 1<br />
Phase 2 Phase 3<br />
Drivers and carriers exempt from the ELD rule may continue to<br />
use any of these methods of record keeping to log their HOS date.<br />
source ©: FMCSA<br />
Safety First<br />
The best argument for introducing<br />
automated vehicles and AI-driven<br />
trucks is the fact that they are safer<br />
for everyone. Long-distance routes<br />
that demand long hours of high<br />
intensity focus and alertness are<br />
dangerous for both the truck driver<br />
and other travelers. Reliable and accurate<br />
AI systems help reduce the<br />
risk of accidents, while reducing the<br />
pressure on the drivers themselves.<br />
The trucking industry is in the midst<br />
of a hiring crisis. “The driver situation<br />
is about as bad as I’ve ever seen<br />
in my career,” Eric Fuller, the CEO of<br />
U.S. Xpress, told Yahoo Finance.<br />
It’s a hard job, and fewer people are<br />
attracted to it. At the same time,<br />
demand for haulage is growing by<br />
leaps and bounds. More autonomous<br />
trucks wouldn’t merely increase<br />
staff safety, they’d also help<br />
resolve capacity issues. Currently,<br />
autonomous trucks still require<br />
human drivers in the cockpit. Howthis<br />
happen more easily and accurately<br />
than ever before and will only<br />
require giving each driver an Electronic<br />
Logging Device (ELD) as part<br />
of their smartphone setup.<br />
In 2015, Saia LTL Freight, a reputed<br />
trucking company in America, installed<br />
sensors in their trucks for<br />
tracking fuel consumption, maintenance<br />
needs and other performance<br />
metrics. This raised the fuel<br />
efficiency of the company by 6 percent<br />
saving millions of dollars.<br />
IoT technology already plays a key<br />
role when it comes to overseeing<br />
the performance of factory equipment<br />
in the manufacturing industry,<br />
highlighting when parts need<br />
replacing and keeping an eye on<br />
the smooth running of key components.<br />
There’s no reason why<br />
the same IoT data and technology<br />
couldn’t be applied to the trucking<br />
industry by installing sensors to anticipate<br />
issues before they arise or<br />
when vehicles need servicing.<br />
This is a particularly attractive concept<br />
for trucking-business owners<br />
and investors. Most of these companies<br />
can run up mountainous annual<br />
repair bills, as high as $15,000<br />
48
per vehicle plus another $4,000 for<br />
tires. Many of the issues that arise<br />
could be spotted earlier using IoT<br />
technology. Cast in this light, smart<br />
trucks would save an immense<br />
amount of money while creating<br />
safer, more efficient fleets at the<br />
same time.<br />
This aspect of AI, called predictive<br />
maintenance, allows problems to<br />
be addressed before they become<br />
severe (and more expensive), generating<br />
both peace of mind and<br />
a better ROI in the process. It’s no<br />
wonder that the vast majority of<br />
trucking business owners firmly believe<br />
that IoT technology is fundamental<br />
to their future success.<br />
Staying Fresh<br />
Sensitive cargo, such as plants and<br />
flowers or time-sensitive perishable<br />
goods, have long been a source of<br />
headaches for the entire industry.<br />
IoT technology can automatically<br />
adjust variables like temperature<br />
and humidity in order to ensure<br />
optimal conditions for such cargo.<br />
Furthermore, it can help drivers<br />
select the best routes, taking into<br />
account road conditions, construction<br />
zones and accidents to ensure<br />
a timely and well-preserved delivery,<br />
both of which are critical for<br />
consistently happy customers.<br />
In the home package delivery industry<br />
(UPS and FedEx), the ability<br />
to track individual items has already<br />
led to increased customer satisfaction.<br />
AI and IoT advancements will<br />
allow this same functionality to be<br />
applied to commercial trucking.<br />
This industry, as much as any, can<br />
use all the trust it can find in order to<br />
future proof it for decades to come.<br />
Last-mile deliveries and just-in-time<br />
services are on the increase, which<br />
means that every second makes a<br />
difference in logistic success rates.<br />
Robots working alongside personnel<br />
in warehouses or working independently<br />
and fully automated,<br />
have already made significant improvements<br />
in efficiency and timesaving<br />
procedures.<br />
Speedier loading and unloading<br />
times allow trucks to complete<br />
more orders in a day. We’re already<br />
seeing the latest robotics technologies<br />
implemented in warehouses<br />
run by companies, such as FedEx,<br />
with impressive results. Automation<br />
in the warehouse is another<br />
way to mitigate issues caused by<br />
worker shortages and offers another<br />
key investment area that could<br />
save the industry millions.<br />
An example of IoT-based solutions<br />
for the trucking industry is App-<br />
Weigh. It is a specially designed<br />
mobile app which uses Bluetoothenabled<br />
weight sensors to measure<br />
the load on air suspension trucks<br />
and trailers throughout shipment.<br />
The truck weight is directly sent to<br />
the drivers on their smartphones<br />
to keep them informed and ensure<br />
their trucks and goods are safely<br />
and legally loaded to their destination.<br />
This app can be useful to<br />
individual truck owners as well as<br />
Weighing In<br />
AppWeigh is a Bluetooth<br />
weight sensor<br />
and app for air suspension<br />
trucks and<br />
trailers that displays<br />
truck weight on a<br />
smartphone to help<br />
truckers load safely<br />
and legally.<br />
transportation and trucking companies<br />
as they alert the drivers and<br />
managers when the weight in the<br />
vehicle crosses the permissible limit<br />
and enables them to take immediate<br />
action.<br />
Endless Potential<br />
There’s no questioning the fact that<br />
robotics, IoT and AI have already<br />
enabled, and will continue to facilitate,<br />
disruption in the trucking<br />
industry, helping business owners<br />
save time and money, while staying<br />
on top of a rapidly changing and<br />
often unpredictable sector. Datadriven<br />
and tech-centric developments<br />
have been the catalysts for<br />
the digital transformation currently<br />
underway within trucking. From all<br />
indications, it appears the industry<br />
will act as a bellwether for the<br />
future of automated vehicles and<br />
logistics.<br />
While many of the technological advances<br />
predicted for the trucking industry<br />
remain in their earliest stages,<br />
it’s clear that the business of trucking<br />
has responded positively and is<br />
quick to adopt the latest IoT developments.<br />
With the potential to<br />
source ©: SKT Technologies Inc.<br />
49
<strong>Smart</strong> Communications Trucking & IoT<br />
become a bonafide, high-tech sector,<br />
the trucking industry is breaking<br />
new technological ground.<br />
Drivers need to follow strict government<br />
regulations. To comply<br />
with the Electronic Logging Device<br />
(ELD) mandate, all trucks must be<br />
equipped with electric devices in<br />
their trucks to track their working<br />
hours and activities. Legally, drivers<br />
can’t drive for more than 10 hours<br />
a day, requiring them to log working<br />
hours. With the adoption of IoT,<br />
trucking companies can easily comply<br />
with this law.<br />
Is This What the Future<br />
Looks Like?<br />
Resembling the helmet of<br />
a Star Wars stormtrooper,<br />
a driverless electric truck<br />
recently began daily<br />
freight deliveries on a<br />
public road in Sweden,<br />
in what developer Einride<br />
and logistics customer DB<br />
Schenker described as a<br />
world first.<br />
troubleshooting without having<br />
to carry well-thumbed, dog-eared<br />
manuals.<br />
Reactions to such advances are<br />
mixed. While up to 65 percent of<br />
transport executives hail automation<br />
and IoT-driven trucking as<br />
nothing short of a renaissance for<br />
the industry, there are legitimate<br />
concerns. There is a real risk of job<br />
losses – a common fear whenever AI<br />
is mentioned. There are also security<br />
concerns regarding the onboard<br />
networks of autonomous trucks<br />
being hacked by cybercriminals,<br />
though advances in anonymity networks<br />
have mitigated those risks.<br />
Yet even staunch critics admit that<br />
the benefits of IoT and AI in trucking<br />
outweigh the mostly theoretical<br />
drawbacks. IoT is a secure, reliable<br />
and cost-effective way to boost the<br />
bottom line of trucking businesses.<br />
The revolution will roll on.<br />
Not a Sound<br />
Scientists at the University<br />
of Michigan<br />
have demonstrated<br />
how sound waves<br />
can be used to<br />
detect and prevent<br />
malicious acoustic<br />
interference with<br />
autonomous truck<br />
systems.<br />
Faster, Faster!<br />
IoT-linked trucks also help the drivers<br />
to do their jobs faster and with<br />
enhanced safety, thus putting<br />
an end to the seemingly endless<br />
queues at gas stations around the<br />
world and speeding up delivery of<br />
food and other essentials. IoT saves<br />
the drivers from paperwork by electronically<br />
updating the fleet managers<br />
about delivery timings, loading<br />
weights and other operational<br />
data. Drivers can also be informed<br />
in advance about diversions, offduty<br />
hours, traffic timings, bad<br />
weather and other relevant information.<br />
When trouble strikes, they<br />
can also get assistance regarding<br />
source ©: University of Michigan<br />
50
That’s why you need storage built to<br />
capture it right where it’s generated<br />
Western Digital is a leader in storage solutions designed and tested to stand up to demanding<br />
IoT and industrial applications. These durable storage devices in a range of capacities are built<br />
for extreme temperatures and environments, and make remote monitoring a breeze.<br />
Embedded<br />
Removable<br />
SSD PCIe<br />
SSD SATA III<br />
Learn more at www.westerndigital.com<br />
Western Digital, the Western Digital logo, and iNAND are registered trademarks or trademarks of Western Digital Corporation or its affiliates in the U.S. and/or other countries.<br />
microSD is a trademark or registered trademark of SD-3C, LLC in the United States and/or other countries. All other marks are the property of their respective owners. As used<br />
for storage capacity, 1 gigabyte (GB) = one billion bytes, and 1 terabyte (TB) = one trillion bytes. Total accessible capacity varies depending on operating environment. Product<br />
specifications subject to change without notice. Pictures shown may vary from actual products. © <strong>2022</strong> Western Digital Corporation or its affiliates. All rights reserved.
<strong>Smart</strong> Business Network Transformation<br />
Network Transformation<br />
Taking Security<br />
to the Edge<br />
52<br />
The ongoing digitisation of the workplace and the rise of the distributed<br />
workforce is forcing companies to redefine the security of their IT infrastructure.<br />
Secure Access Service Edge, or SASE, is a holistic security architecture<br />
combining both network and security services in a software-defined cloud<br />
architecture which may provide the answer to these challenges.<br />
n By Sebastian Ganschow
for branch offices that were connected<br />
directly to the data center,<br />
where internal applications were<br />
hosted and Internet traffic could<br />
be filtered. But with working from<br />
home becoming an option for<br />
many employees, apps and data<br />
need to be dispersed across locations.<br />
IT teams face the challenge of<br />
providing secure, authorised access<br />
while maintaining quality of experience<br />
across any device and location.<br />
Network Security Meets<br />
Security at the Edge<br />
The Secure Access Service Edge, or<br />
SASE model is becoming increasingly<br />
important for many large organisations.<br />
Already, 24 percent of<br />
enterprises plan to develop strategies<br />
to implement the SASE approach<br />
outlined by Gartner, a consultancy,<br />
by 2024 at the latest.<br />
SASE is a cloud-centric architecture<br />
that represents a convergence<br />
of software-defined wide<br />
area networking (SD-WAN) and<br />
high security in a strategic edgeto-cloud<br />
service that adds neither<br />
hardware cost nor complexity. In<br />
other words, SASE describes an<br />
architecture that delivers network<br />
services and security functions<br />
as cloud services where they are<br />
needed: On end devices and at the<br />
SASE<br />
facilitates a<br />
better<br />
response<br />
to internal<br />
and external<br />
changes.<br />
Sebastian Ganschow<br />
is Director Cybersecurity<br />
Solutions at NTT Ltd.<br />
The End of Point<br />
Solutions<br />
SASE combines<br />
the functions of<br />
network and security<br />
point solutions in a<br />
unified, global cloudnative<br />
service, with<br />
a profound impact<br />
on several IT areas<br />
at once.<br />
edge, where a permanent connection<br />
to networks is not possible or<br />
even necessary.<br />
Although each company is taking<br />
a different path, a strategic SASE<br />
vision includes both a fundamental<br />
shift in access controls to where<br />
they are needed - the end user and<br />
the cloud edge – and the search<br />
for less complexity. Convergence<br />
of security functions in an efficient<br />
as-a-service model are a good way<br />
to achieve these goals.<br />
In addition, SASE can focus on<br />
supporting business agility to respond<br />
to all internal and external<br />
changes, while at the same time<br />
simplifying deployment, management,<br />
and enforcement of<br />
source ©: IDG Business Media GmbH<br />
SD-WAN<br />
Carrier<br />
Network Security<br />
Large enterprises still operate<br />
huge data centres. These<br />
contain not only local SaaS<br />
(Software-as-a-Service) applications,<br />
but also network components<br />
such as firewalls, load<br />
balancers, intrusion detection and<br />
prevention systems, routers and<br />
switches. Just a few years ago, it<br />
was common to design networks<br />
WAN<br />
Optimization<br />
Bandwidth<br />
Aggregation<br />
Networking<br />
Vendors<br />
Network as a<br />
Service<br />
Network<br />
CDN<br />
SASE<br />
Security<br />
DNS<br />
CASB<br />
Cloud SWG<br />
ZTNA/VPN<br />
WAAPaaS<br />
FWaaS<br />
RBI<br />
source ©: Inseya AG<br />
53
<strong>Smart</strong> Business Network Transformation<br />
a range of professionals - network<br />
engineers, application developers<br />
and security specialists. For some<br />
organisations, this means requiring<br />
a common working language between<br />
IT and security departments<br />
for the very first time.<br />
In addition, organisations need to<br />
include strategic stakeholders such<br />
as human resources, access mansource<br />
©: Musarubra US LLC<br />
policies across the board. SASE as<br />
a "secure-by-design" interface for<br />
network and cybersecurity aims at<br />
breaking down silos in order to deliver<br />
seamless, scalable, and secure<br />
Internet and cloud access anytime,<br />
anywhere.<br />
Adopting SASE requires a convergence<br />
of skills and capabilities and a<br />
new level of collaboration between<br />
The Quickest Route<br />
to SASE<br />
Decision makers seek a<br />
faster, more efficient high<br />
road to cloud and network<br />
transformation without compromising<br />
security. The need<br />
for speed and scalability is<br />
crucial, but corners cannot<br />
be cut when it comes to<br />
maintaining data and threat<br />
protection.<br />
Centralised Management<br />
with less Complexity<br />
Many organisations begin their<br />
SASE journey by introducing a centralised<br />
way to manage policy creation<br />
and monitoring. In the next<br />
step, they implement advanced security<br />
services from the data centre<br />
to each cloud required by the site,<br />
user or IoT device. By combining<br />
multiple security capabilities into<br />
a single cloud-native service, CIOs<br />
and CISOs can build greater centralised<br />
management capability with<br />
less complexity. Thus, SASE effects<br />
more than just technology conver-<br />
agement and compliance officers<br />
in the conversation. Only then can<br />
they define advanced policies for<br />
data loss prevention (DLP), cloud<br />
access security brokers (CASBs) and<br />
zero trust network access.<br />
A SASE approach requires the integration<br />
of multiple security and IT<br />
services from an organisation's first<br />
line of defense, to a DNS layer, to a<br />
secure web gateway for zero trust<br />
that enables deeper inspection, to a<br />
cloud firewall that protects web and<br />
non-web traffic.<br />
Expectations<br />
Multicloud Networking<br />
LEO Satellite Systems<br />
Software-Defined Cloud Interconnect<br />
Kubernetes Networking (CNI)<br />
AIOps Platforms<br />
Network Observability<br />
Enhanced Internet<br />
Wi-Fi 7<br />
eBPF<br />
Private 5G<br />
FACs (<strong>Smart</strong>NICs)<br />
SASE<br />
NVMe-oF<br />
5G<br />
400 Gbps Ethernet<br />
NaaS<br />
SD-Branch<br />
Network Automation<br />
Open Networking<br />
Service Mesh<br />
IPv6<br />
Wi-Fi 6<br />
SD-WAN<br />
Microsegmentation<br />
New New Path Forward<br />
SASE includes the ability to<br />
be delivered to enterprises as<br />
a managed cloud service, as<br />
well as to shift away from a<br />
traditional box-heavy branch<br />
(i.e., next-generation firewall,<br />
branch routers, etc.) to a thin<br />
branch (with SD-WAN) and a<br />
heavy cloud model.<br />
NDN<br />
6G<br />
Intent-Based Networking<br />
NFV<br />
ZTNA<br />
SDN<br />
source ©: Inseya AG<br />
54<br />
Innovation<br />
Trigger<br />
Peak of Infated<br />
Expectations<br />
Time<br />
Trough of<br />
Disillusionment<br />
Plateau will be reached: 10 yrs. Obsolete before plateau<br />
Slope of<br />
Enlightenment<br />
Plateau of<br />
Productivity<br />
As of July 2021
Traditional Hub-and-Spoke Architecture<br />
Services<br />
Apps<br />
Fast, but Just not<br />
Fast Enough<br />
Conventional<br />
hub-and-spoke<br />
architecture cannot<br />
keep pace with the<br />
escalating demands<br />
of edge-centric<br />
computing.<br />
Internet<br />
B r a n c h<br />
B r a n c h<br />
B r a n c h<br />
Headquarters<br />
D e d i c a t e d B r o a d b a n d<br />
B r a n c h<br />
B r a n c h<br />
B r a n c h<br />
source ©: Infoblox<br />
gence – it’s where business value is<br />
created and protected.<br />
Simplification and security are the<br />
two big drivers for network modernisation.<br />
One of the key benefits<br />
of this new approach is centralised<br />
network monitoring and management.<br />
Regardless of data centre<br />
or network perimeter monitoring,<br />
convergence lowers costs and increases<br />
cross-tier visibility in hybrid<br />
environments.<br />
A common framework for analysing<br />
users, applications, and data<br />
provides a comprehensive understanding<br />
of all issues and allows<br />
for faster resolution. The unified<br />
interface provides far more detailed<br />
and consistent analysis and<br />
reporting, ensuring more expeditious<br />
decision making and efficient<br />
performance management.<br />
SASE builds on the connectivity<br />
benefits of SD-WAN and includes<br />
optimised MPLS, Internet, and<br />
hybrid connectivity, as well as an<br />
integrated security system. It simplifies<br />
branch office networking by<br />
replacing the multitude of network<br />
devices found in many enterprises<br />
with a simple system that provides<br />
access to a wide range of services.<br />
This approach significantly reduces<br />
the time and effort required<br />
for configuration monitoring and<br />
troubleshooting of network and<br />
Getting the Work<br />
Done Faster<br />
Cutting the time<br />
needed to configure,<br />
monitor and troubleshoot<br />
network security<br />
functions is a great<br />
benefit.<br />
security functions. Finally, new<br />
applications or services can be<br />
deployed much faster. This is not<br />
just another argument for automation,<br />
but rather a leap forward in<br />
speedy, granular policy definition<br />
to meet rapidly changing business<br />
needs.<br />
55
<strong>Smart</strong> sensors for<br />
the next automation age<br />
The Automation age describes<br />
an epoch when machines<br />
began to perform<br />
complex tasks with little to<br />
no human interactions. Today we<br />
are experiencing a new type of automation<br />
enabled by the proliferation<br />
systems composed of interconnected,<br />
miniaturized objects and<br />
systems able to sense, process and<br />
take actions. The number of such<br />
devices is growing exponentially<br />
and with increasingly complex functionality,<br />
requiring more powerful<br />
cloud infrastructure. This creates<br />
a need to distribute intelligence,<br />
such as AI processing, throughout<br />
the system. This enables local smart<br />
controls, while helping protect user<br />
privacy and lowering overall system<br />
power consumption.<br />
Combining edge processing with<br />
cloud connectivity brings flexibility<br />
to system design and enables op-
Advertorial<br />
timal balance between offline and<br />
online capabilities. Advanced smart<br />
sensors bring intelligent processing<br />
to the point closest to the data<br />
generation by incorporating this<br />
processing capability into the sensor<br />
itself.<br />
One approach to achieve this is to<br />
equip the sensor with a Machine<br />
Learning Core (MLC) using a Finite<br />
State Machine (FSM) and advanced<br />
digital functions. Instead of using<br />
a microcontroller to process data,<br />
the MLC can run a decision tree, an<br />
inductive algorithm at a fraction of<br />
the power consumption. As a result,<br />
the system can recognize specific<br />
activities or events by observing<br />
movements or state changes and<br />
inferring from predefined patterns.<br />
This approach brings challenges<br />
for system design, particularly in<br />
terms of processing power, packaging,<br />
and power consumption. A<br />
clear challenge for sensor makers<br />
is to add AI processing capabilities<br />
without disrupting their proven solution<br />
for low noise, low power, and<br />
high accuracy - and also without<br />
changing the package form factor.<br />
Keeping the same package as existing<br />
sensors offers system designers<br />
flexibility on sensor selection without<br />
changing board design.<br />
ST has introduced a range of smart<br />
sensors that tackle these challenges<br />
starting with the LSM6DSOX<br />
launched in 2019. These sensors<br />
have a Machine Learning Core incorporated<br />
into the sensor itself with<br />
LSM6DSV16X<br />
and FSM and configurable decision<br />
trees. Our latest products continue<br />
to improve key parameters for<br />
developers such as performanceper-watt<br />
ratio. An example is the<br />
LSM6DSV16X, the newest member<br />
of our family of inertial MEMS with<br />
a machine learning core, launched<br />
earlier this year and available from<br />
mid <strong>2022</strong> .<br />
The LSM6DSV16X also introduces a<br />
new feature called Qvar to the LSM6<br />
family of devices. Engineers only<br />
need to connect two electrodes to<br />
measure variations in quasi-electrostatic<br />
potential and change two<br />
registers to enable the feature. Qvar<br />
opens the door to new applications,<br />
such as people counting. Instead of<br />
using an LED and photodiode, engineers<br />
can place electrodes on walls<br />
and measure if someone walks near<br />
them. The LSM6DSV16X remains<br />
pin-to-pin compatible with the other<br />
members of the LSM6DS family.
<strong>Smart</strong> Business EV Charging<br />
EV Charging<br />
Current Trends<br />
The electric vehicle industry is on its way to market maturity but there are still<br />
twists in the road for stakeholders and customers. From accessibility<br />
and standardisation issues to a lack of convenient and secure payment methods<br />
at charging stations, unresolved issues could still throw a spoke in the wheel<br />
of electric vehicles, leaving full adoption out of reach.<br />
n By Mark McCoy<br />
58
Electric vehicles (EVs) are<br />
cool. They offer a smooth<br />
ride and they’re good for<br />
the environment. For many,<br />
the attraction of EV ownership is<br />
also financial. For example, a 2020<br />
survey by smart charging solutions<br />
provider NewMotion, due to be renamed<br />
Shell Recharge Solutions,<br />
found that 61 percent of EV drivers<br />
were motivated to switch to save<br />
money. If so, what’s keeping them<br />
from widespread adoption?<br />
“The most common issues we see<br />
centre around accessibility and<br />
availability,” says Sjors Martens,<br />
the commercial director of chargepoint<br />
data provider Eco-Movement.<br />
“Charging points that are<br />
private or closed are a nuisance! In<br />
fact, 36 percent of charge points<br />
we receive have either restricted<br />
accessibility or are private. Without<br />
intervention from a company<br />
like ours, they’d be displayed on a<br />
map without any warning.”<br />
As if the automotive industry<br />
didn’t have enough problems already<br />
with eMobility, such as secure<br />
payment methods, concerns<br />
about carbon emissions and urban<br />
pollution are driving the manufacturers<br />
to introduce hybrid and fully<br />
electric powertrains. This work is<br />
being aided by steadily improving<br />
battery and motor technology but<br />
is being held back by the ‘chicken<br />
and egg’ problem of charging the<br />
new vehicles.<br />
To ensure that EVs have the same<br />
freedom to roam as today’s fossilfuel<br />
cars, a few challenges need to<br />
be addressed. Experts agree that<br />
charging has to become faster, the<br />
world’s network of petrol stations<br />
has to be upgraded with electriccharging<br />
facilities, and standalone<br />
charging stations will be necessary<br />
to compensate for the EV’s relatively<br />
limited range.<br />
The obvious answer is to align<br />
all charging points on data standards,<br />
providing EV drivers with a<br />
consistent experience no matter<br />
where they are. But, as Martens explains,<br />
that’s easier said than done:<br />
“Charge point operators are often<br />
source ©: Eco-Movement<br />
too busy focusing on exponential<br />
growth to work on data and standards.<br />
Furthermore, the type of<br />
charging points, definitions and<br />
regulations are vastly different<br />
across Europe alone, which makes<br />
it difficult to align perspectives.”<br />
Local conditions also dictate if<br />
private charging points can be installed,<br />
for example, having a private<br />
parking space at your home<br />
is the norm in Belgium but it’s still<br />
the exception in next-door Netherlands.<br />
Even so, resistance to EVs seems to<br />
defy logic. Even a simple back-ofthe-envelope<br />
calculation suggests<br />
that filling your tank with petrol is<br />
Charging<br />
points that<br />
are private<br />
or closed are<br />
a nuisance!<br />
Sjors Martens<br />
Eco-Movement<br />
A Winning Team<br />
Dutch ESS provider Alfen<br />
teamed up with fuel vendor<br />
Shell to deploy a 350kWh<br />
battery storage system at a<br />
forecourt in Zaltbommel, the<br />
Netherlands, offering gridbalancing<br />
services.<br />
like connecting your car to a 5MW<br />
energy source. By contrast, Tesla<br />
announced in March 2019 that<br />
its V3 Superchargers will deliver<br />
energy at rates of up to 250kW, although<br />
it will take a liquid-cooled<br />
charging cable to make it possible.<br />
EV charging obviously has a way<br />
to go before it can catch up with<br />
internal combustion engines in<br />
terms of convenience and practical<br />
reliability. It will take a combination<br />
of high voltages, high<br />
currents and sophisticated power<br />
conversion, filtering and charge<br />
management systems to close<br />
the gap. This, in turn, will demand<br />
the deployment of some pretty<br />
sophisticated connectors, cables,<br />
relays, conversion electronics and<br />
passives to ensure the same kind<br />
of fast, safe energy top-up offered<br />
by today’s petrol stations.<br />
Charging Network Growth<br />
So how close are we to a nationwide<br />
charging network that drivers<br />
can rely on when they need it,<br />
rather than having to hopscotch<br />
between charging stations? Tesla<br />
claimed it had more than 12,000<br />
Superchargers in North America,<br />
Europe and Asia at the end of 2021.<br />
This would cover more than 99<br />
source ©: Alfen N.V.<br />
59
<strong>Smart</strong> Business EV Charging<br />
The EV market Protocols<br />
percent of the US population and<br />
the company expects to achieve<br />
similar distribution in Europe by<br />
the end of this year. Tesla also<br />
claims that it recently achieved<br />
coverage of more than 90 percent<br />
of the Chinese population.<br />
Building charging networks looks<br />
like it will be big business. A report<br />
from Markets and Markets foresees<br />
that EV charging stations will<br />
grow from $3.22 billion in 2017 to<br />
$30.41 billion by 2023, an annual<br />
growth rate of 41.8 percent. The<br />
report offers a number of justifications<br />
for its forecast, including<br />
subsidy programmes for purchasing<br />
EVs in various countries, and a<br />
US government initiative to develop<br />
48 charging networks that will<br />
together cover about 25,000 miles<br />
(40,000 kilometres) of US highways<br />
across 35 states. This initiative led<br />
28 states, utilities, charging firms<br />
and electric vehicle companies,<br />
including GM, BMW and Nissan, to<br />
start working together.<br />
AC or DC?<br />
These raw numbers appear encouraging<br />
for potential EV drivers<br />
but mask the fact that there is still<br />
a lot of variety in charging methods,<br />
the infrastructure available<br />
to support them and, therefore,<br />
TSO<br />
System Operator<br />
• eclearing.net<br />
• Gireve<br />
• Hubjet<br />
Common Cause<br />
The evRoaming4EU consortium<br />
is a partnership project<br />
aimed at ensuring that<br />
any EV driver will be able<br />
to charge at any charging<br />
station in the EU. Its goal<br />
is to address and resolve<br />
functional, technical,<br />
legal, and fiscal obstacles<br />
that exist today between<br />
different countries within<br />
the European Union and<br />
create a mature European<br />
market for EV charging.<br />
infrastructure.<br />
Hub<br />
Roaming<br />
Platform<br />
DSO<br />
Grid Operator<br />
Sustaiable Home /<br />
<strong>Smart</strong> Home<br />
A Growing Market<br />
The EV charger market<br />
in Europe alone reached<br />
1.7 million in 2020,<br />
says IHS, and further<br />
explosive growth is to be<br />
expected over the next<br />
few years.<br />
OCPI (Hub)<br />
OCHP<br />
OICP<br />
eMIP<br />
OSCP<br />
MSP<br />
Service<br />
Provider<br />
OCPI (P2P)<br />
Adm<br />
CPO<br />
Tech<br />
CPO<br />
their usability to the average user.<br />
One big issue has the potential to<br />
reignite the legendary War of the<br />
Currents between Thomas Edison<br />
and George Westinghouse in<br />
the late 1880s and early 1890s.<br />
Edison’s arc lamp street lighting<br />
system ran on low-voltage direct<br />
current (DC), while Westinghouse<br />
championed the rival alternating<br />
current (AC) power distribution<br />
network, which ultimately<br />
triumphed – but not before the<br />
two engineers-turned-entrepreneurs<br />
threw mud at each other,<br />
with Edison even going so far as<br />
to equate Westinghouse and his<br />
system with the electric chair.<br />
The real difference between the<br />
two charging strategies is where<br />
EV driver<br />
OCPP<br />
ISO 15118<br />
Charging Point<br />
Open ADR/<br />
IEC 61850<br />
Energiy Supplier<br />
the necessary transformation is<br />
done. Electric grids deliver AC<br />
which needs to be rectified to the<br />
appropriate DC charging voltage<br />
with the help of technology built<br />
into the car itself. DC charging<br />
stations, on the other hand, use<br />
larger, more efficient and bettercooled<br />
rectification circuitry than<br />
would be possible in a vehicle.<br />
Many predict that, over time, AC<br />
charging stations will do their<br />
own rectification but the jury is<br />
still out.<br />
In addition to charging power,<br />
the decision to use either AC or<br />
DC charging also depends on<br />
the capital costs of rectification<br />
and who will pay: the operators<br />
of the DC charging networks or<br />
source ©: Netherlands Enterprise Agency<br />
Global Cumulative Charging Station Deployments (2014 – 2020)<br />
source ©: IHS Automotive<br />
60<br />
14<br />
12<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
2011 2012 2013 2014 2015 2016 2017 2018 2019 2020
the owners of e-vehicles charged<br />
with AC. Some charging standards<br />
also allow bi-directional<br />
energy flow, so a distributed network<br />
of charging vehicles can<br />
act as both an energy sink and a<br />
source to stabilise the energy grid<br />
– which could lead to regulatory<br />
support in some regions.<br />
While some automobile vendors<br />
like Tesla are trying to control their<br />
customer base by installing proprietary<br />
chargers and connectors,<br />
others like BMW, Mercedes-Benz<br />
maker Daimler, Ford and the Volkswagen<br />
Group, which includes<br />
Audi and Porsche, are all backing<br />
a multi-vendor, multi-technology<br />
standard known as the Combined<br />
Charging System (CCS).<br />
As has been seen multiple times<br />
in other technology evolutions,<br />
the perceived benefits of lock-in<br />
are slowly giving way to standardisation<br />
efforts, as EV customers<br />
begin to demand ubiquitous<br />
charging facilities and weigh their<br />
availability more highly in their<br />
buying decisions. This is leading<br />
to a shake-out in the market<br />
for EV charging. Nissan and Mitsubishi<br />
have backed CHAdeMO<br />
(Charge de Move), which allows<br />
bi-directional charging. China,<br />
the world’s largest EV market, is<br />
establishing GB/T (which means<br />
it’s a favored Chinese regulation)<br />
as its charging standard.<br />
There is obviously still a lot of<br />
room for component manufacturers<br />
to innovate. For example,<br />
if rectification in the vehicle becomes<br />
more efficient, this will<br />
have a direct impact on the utility<br />
of an e-vehicle by enabling faster<br />
charging with AC power. Even the<br />
design of the plug will be a critical<br />
factor in the speed of charging<br />
and all this will help increase the<br />
practical range of an electric vehicle<br />
(see boxout).<br />
Of course, all of these innovations<br />
will have to comply with<br />
national and international standards,<br />
many of which are still being<br />
developed and agreed. As EVs<br />
move ahead to replace fossil-fuel<br />
vehicles, the race for EV market<br />
dominance will almost certainly<br />
be fast and furious.<br />
Interview<br />
How close are we to a nationwide<br />
charging network or maybe<br />
even to a Europe-wide charging<br />
network?<br />
With ISO 15118, we actually have<br />
a pretty good world-wide stansource<br />
©: Thomas Wagner<br />
We need a<br />
faster rollout.<br />
Thomas Wagner<br />
Of in-tech, a pioneer<br />
smart charging company<br />
based in Bavaria<br />
dard, except for China and Japan<br />
which choose to go their own<br />
way. Most companies are working<br />
together because they know<br />
that’s where the future of electromobility<br />
lies, namely in vehicle to<br />
grid and sectoral coupling of energy<br />
and mobility.<br />
Is the energy sector ready?<br />
I think the energy sector needs<br />
to talk more with the mobility<br />
sector, and vice versa. We need<br />
a faster rollout. It’s important<br />
that everyone profits: the manufacturers,<br />
the operators, the end<br />
users, and, of course, both the<br />
charging business and the energy<br />
sector.<br />
What are the biggest priorities<br />
in radically expanding electricvehicle<br />
(EV) charging infrastructure<br />
We need much higher numbers<br />
of charging stations and we need<br />
them much faster as electric vehicle<br />
sales are gaining speed. So I'm<br />
mainly talking about high power<br />
charging parks and also AC charging<br />
at home and at work.<br />
What role will governments play?<br />
After all, many legal standards<br />
and regulations aren’t even fully<br />
developed yet.<br />
Right, national politics has to<br />
support international standards<br />
and international business cases<br />
because EV will be a truly global<br />
market.<br />
61
<strong>Smart</strong> Lifestyle Urban Renewal<br />
Urban Renewal<br />
The<br />
<strong>Smart</strong>est<br />
City<br />
In 2000, Barcelona’s council created 22@ Barcelona<br />
as an urban transformation project with the aim of turning a rundown<br />
industrial area called Poblenou into a new innovation district.<br />
Today, the neighborhood is buzzing with creative startups,<br />
research centres and international businesses and is regularly touted<br />
as an example of urban, economic and social renewal.<br />
62
The Poblenou district of Barcelona<br />
long reflected the wider<br />
malaise of Barcelona. Once<br />
a thriving industrial district<br />
in the 19th Century, it gradually became<br />
the ideal canvas for spraycanwielding<br />
graffitists. Between 1970<br />
and 1990, some 1,300 firms closed,<br />
leaving the area littered with abandoned<br />
buildings: a decaying postindustrial<br />
landscape.<br />
Barcelona’s city council seized the<br />
opportunity offered by the 1992<br />
Olympics to refresh the city. A modern<br />
infrastructure, revamped neighborhoods,<br />
greener parks and a new<br />
two-kilometre sandy beach opened<br />
the city up to the Mediterranean Sea.<br />
The revitalisation made Barcelona a<br />
tourist must-visit destination again.<br />
And Poblenou? It, too, is awakening<br />
from its long sleep to become a<br />
torch bearer for urban renewal.<br />
Much of Poblenou’s renaissance has<br />
been built on IoT systems. Starting in<br />
2012, the city deployed responsive<br />
technologies across public transport,<br />
parking, street lighting and<br />
waste management systems as part<br />
of a <strong>Smart</strong> City Barcelona plan.<br />
Transitioning to a more energyefficient<br />
LED lighting system has<br />
led to cost savings. Sensors in lampposts<br />
identify when pedestrians are<br />
near and dim automatically if the<br />
streets are empty to save energy.<br />
The lampposts form part of a WiFi<br />
source ©: El País<br />
network, too, providing consistent,<br />
city-wide, free connectivity anytime,<br />
anywhere. The network is also integrated<br />
into Sentilo, a system of over<br />
19,500 smart meter sensors that receive<br />
data on weather, pollution and<br />
noise. IoT devices also monitor rain,<br />
humidity and soil moisture in city<br />
gardens. Using the data, gardeners<br />
can remotely programme electrovalves<br />
to deliver any irrigation needed.<br />
This has resulted in savings of approximately<br />
€500,000 per year.<br />
For cars, embedded sensors in parking<br />
bays identify if they are occupied.<br />
Drivers are guided to available<br />
spaces through ApparkB, an app<br />
that allows online payment for parking.<br />
This has reduced congestion<br />
and emissions.<br />
The innovations continue with<br />
smart pneumatic waste bins that<br />
Home to the Future<br />
Ten universities, nine<br />
R&D and technology<br />
transfer centres, and a<br />
spaceship tower,<br />
the 142 m high Torre<br />
Glòries, Barcelona's<br />
new signature skyscraper.<br />
City in the City<br />
The Interface Building,<br />
headquarters of the<br />
Telecommunications<br />
Market Commission,<br />
contains over 42,000<br />
sqm of office space.<br />
reduce odors and new interactive<br />
bus stops, powered by solar panels,<br />
offer USB charging stations and updates<br />
on bus arrivals.<br />
The Knowledge<br />
Neighbourhood<br />
In 2000, €200 million was earmarked<br />
to foster the Barcelona technology<br />
industry. Twenty-two acres of Poblenou<br />
was to be recast as an innovation<br />
district and its name change<br />
said it all. Formerly called 22a (Industrial),<br />
it became 22@ – tagging<br />
it as a digital testing ground. Visit<br />
the district today and any fresh graffiti<br />
will be by renowned local artists,<br />
commissioned by one of the design,<br />
energy, media or scientific research<br />
companies that call 22@ home.<br />
The triangle formed between the<br />
seafront, Avinguda Diagonal and<br />
Ciutadella Park is a hotbed of innovation.<br />
Five universities and academic<br />
institutions have a presence,<br />
and co-working spaces, incubators<br />
and startups abound.<br />
Famous brands present include Amazon,<br />
HP, T-Systems, Ricoh, Schneider<br />
Electrics and Vice Media. Sergio<br />
Ruiz, CEO of the Signaturit Group,<br />
an electronic signature software<br />
company, says the decision to open<br />
in Poblenou was easily made.<br />
“You can really breathe innovation<br />
and technology here,” he explains.<br />
“22@ is a hub that allows us to connect<br />
with other technology companies<br />
and promote innovation. This<br />
allows the development of new opportunities<br />
in our business. It is the<br />
ideal ecosystem for synergies.”<br />
source ©: patrizia.ag<br />
63<br />
source ©: Innovation Academy e.V.
<strong>Smart</strong> Lifestyle Urban Renewal<br />
It is estimated that 4,500 new companies<br />
have come to Poblenou<br />
since 2000. Of these, 47 percent<br />
are startups, and 31 percent are<br />
technology or knowledge-based<br />
companies. Before Covid-19 struck,<br />
around 56,000 tech talents had<br />
been attracted to the area and the<br />
total number of jobs created was<br />
estimated at 150,000.<br />
Old Charm, New Tech<br />
Poblenou is far from a business district<br />
where the lights go out at night.<br />
The redevelopment was not intended<br />
to run slipshod over existing residents<br />
but to make 22@ an appealing<br />
place to live. This included developing<br />
4,000 units of subsidised housing,<br />
creating new green areas, remaking<br />
streets and providing facilities for the<br />
public, such as schools and community<br />
centres.<br />
For this, the support of the real estate<br />
sector was critical. If educated professionals,<br />
tech-savvy workers and other<br />
creatives were to be attracted, they<br />
needed office and living spaces. By<br />
2011, there were 139 plans submitted<br />
for urban redevelopment, 84 from<br />
the private sector.<br />
"What caught our eye was not just<br />
the basic economics and demographics,<br />
it was also that people want<br />
to live there, that the universities are<br />
Cool Quarter<br />
With Poblenou,<br />
Barcelona has succeeded<br />
in rebranding<br />
itself as a city<br />
for business, talent<br />
and innovation.<br />
More Than Green<br />
The 22@Barcelona<br />
project transforms two<br />
hundred hectares of<br />
industrial land of Poblenou<br />
into an innovation<br />
hub. An estimated<br />
4,500 new companies<br />
have come to Poblenou<br />
since 2000. Of these,<br />
47 percent are startups.<br />
expanding, and that 22@ is increasingly<br />
regarded as a smart city," says<br />
Eduardo de Roda, country manager<br />
for Patrizia, an international asset<br />
management company focusing on<br />
innovation technology in the real estate<br />
industry.<br />
On behalf of clients, Patrizia has invested<br />
in five office and residential<br />
buildings. Two are redevelopments<br />
of old industrial space and the goal<br />
is to create sustainable buildings, reflecting<br />
the changing local environment.<br />
“Although 22@ is one of the largest<br />
urban regeneration areas in Europe,<br />
there is still a major shortage of Grade<br />
A office stock. We aim to address that<br />
demand,” says de Roda.<br />
Walk the streets of Poblenou and you<br />
find a lively scene, half bohemian<br />
and half cybernetic. La Rambla del<br />
Poblenou, the promenade that cuts<br />
through the district to the sea, has<br />
been revitalised with top-notch restaurants,<br />
microbreweries and shops.<br />
In the backstreets alternative art galleries,<br />
advertising agencies, architect<br />
firms, dance companies and designer<br />
showrooms burnish the reputation<br />
of Poblenou as Barcelona’s cool new<br />
barrio. It is certainly an eclectic mix.<br />
source ©: Parametric Places: Data Making + Public Space<br />
64
source ©: Patrizia AG<br />
Modernista constructions like the<br />
tubular Torre Glòries and the Design<br />
Museum of Barcelona loom large –<br />
but there has been considerable effort<br />
to preserve the heritage.<br />
Cisco invested $30 million in developing<br />
a co-innovation centre, focused<br />
on the Internet of Everything (IoE),<br />
in a former textile factory. An artistic<br />
colony occupies the Palo Alto Market<br />
area, and the Pompeu Fabra University's<br />
Communication Campus and<br />
From old to new<br />
The former industrial<br />
slum of Poblenou has<br />
been transformed<br />
into the throbbing<br />
heart of a new city by<br />
a mix of careful conservation<br />
and striking<br />
modernisation.<br />
the Fundació Vila Casa Museum are<br />
housed in renovated textile factories.<br />
November 2020 marked the twentieth<br />
anniversary of the 22@ urban<br />
planning project and provided an<br />
opportunity to reassess its direction.<br />
The council plans to open the district<br />
to green companies and more<br />
space was earmarked for 9,300 rental<br />
homes – but this looks like it will be<br />
increased to around 15,800 residential<br />
apartments.<br />
“It is the mix of uses that we like about<br />
22@,” explains de Roda. “How the office<br />
and living spaces are revitalising<br />
the quarter to create a new, dynamic<br />
and compelling lifestyle. That’s the<br />
attraction for the creative classes and<br />
will ensure they will continue to be<br />
drawn to the area.”<br />
Interview<br />
Solutions by the People, for the People<br />
How is Barcelona approaching<br />
IoT?<br />
Barcelona is transforming itself into<br />
a true smart city. The areas they have<br />
focused on – environmental monitoring,<br />
parking, waste disposal and smart<br />
lighting – provide them with a solid<br />
platform for continuing to develop in<br />
the future. Importantly, they have put<br />
all this in place not for the sake of the<br />
technology but because it provides<br />
solutions for the needs of people.<br />
What are the main challenges?<br />
First – scale. With a project like this,<br />
you only benefit when you cover a<br />
large area. This can pose problems<br />
because of the physical environment<br />
or the ‘not in my backyard’ attitudes.<br />
Barcelona has overcome this by effectively<br />
scaling proven technology from<br />
its Urban Lab out over the wider city.<br />
Any others?<br />
There are issues concerning retrofitting<br />
the urban landscape to handle<br />
new technology. For example, providing<br />
power to the parking place<br />
sensors. There is also security. A parking<br />
app helps cut down on pollution<br />
and congestion but it also marks<br />
where the car and owner will be for<br />
the next few hours, so security is an<br />
issue.<br />
There are some pretty nifty<br />
gadgets installed around here. Is<br />
theft a big problem?<br />
With such innovative products, tampering<br />
happens more often than you<br />
might think. Safeguards have to be<br />
put in place to protect the devices.<br />
What’s the payback?<br />
There are two: cost savings and the<br />
ability to influence behavior. Thanks<br />
to IoT, Barcelona has reduced congestion<br />
and lowered car emissions,<br />
water and energy costs. It has also<br />
brought significant economic development.<br />
The quality of life for<br />
residents, workers and visitors has<br />
Thanks to IoT,<br />
Barcelona<br />
has reduced<br />
congestion and<br />
lowered car<br />
emissions,<br />
water and<br />
energy costs.<br />
Giulio Spinelli<br />
EMEA <strong>Smart</strong> City<br />
Business Development<br />
Manager and technology<br />
specialist for timing and<br />
sensing at Avnet Silica,<br />
lives and works in Milan<br />
also improved. Also, collecting data<br />
can help government agencies place<br />
infrastructure where it’s needed in a<br />
far more focused manner. When that<br />
data is also made available to the<br />
public in effective formats, it can encourage<br />
behavioral changes. People<br />
can see it is far quicker to take a bike<br />
than a car for a short trip, or to leave<br />
a trip until later when the pollution<br />
will not be as bad.<br />
source ©: Facebook<br />
65
<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />
IoT and Fighting Forest Fires<br />
Internet of<br />
Trees<br />
66
An hour can make all the difference. In an hour you can weed the<br />
garden, mow the lawn, plant a tree. In that same hour,<br />
as gardeners who make compost may know to their cost,<br />
a smouldering pile of biomass can easily burst into flames.<br />
When this happens in a forest, it can start a fire that<br />
ravages thousands of square kilometres and costs hundreds<br />
of millions of dollars to control.<br />
n By Mark McCoy<br />
Being able to discover forest<br />
fires early is an increasingly<br />
urgent issue. According<br />
to Cal Fire, California’s<br />
firefighting agency, nine of California’s<br />
20 largest fires to date<br />
have occurred since 2020. California’s<br />
Dixie fire, which began in<br />
mid-July 2021, grew to consume<br />
almost 4,000 square kilometres of<br />
forest by the end of September.<br />
According to the New York Times,<br />
authorities spent more than $610<br />
million over those three months<br />
to bring it under control. There<br />
have been similarly extreme fires<br />
over the past five years in places<br />
as far afield as Australia, Greece,<br />
and Portugal. And it’s a growing<br />
issue: the map below shows just<br />
how much of the planet’s surface<br />
Fires are a<br />
growing Issue<br />
A map of global<br />
vulnerability<br />
to wildfires.<br />
is now extremely vulnerable to<br />
wildfires.<br />
The ability to find and suppress<br />
forest fires before they take hold is<br />
therefore of immense value, but it’s<br />
a hard problem to solve given how<br />
large forests can be, the lack of infrastructure<br />
within them, and the<br />
challenge of sensing the earliest<br />
stages of a fire before it bursts into<br />
flames. A Berlin-based startup has<br />
decided to be up for the challenge<br />
and is addressing it by developing<br />
advanced sensing nodes and highly<br />
distributed networking technology.<br />
Although Dryad’s initial focus<br />
is to detect fires, it expects that its<br />
system will also be able to monitor<br />
other aspects of forestry, such<br />
as soil moisture, tree growth, sap<br />
flow, and even illegal logging.<br />
source ©: Dryad Networks<br />
67
<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />
The same technology should also<br />
enable air and water quality monitoring<br />
over large areas.<br />
A Network of Networks<br />
Dryad’s Silvanet is made up of five<br />
major components: three pieces<br />
of hardware, a proprietary RF networking<br />
technology that extends<br />
the reach of the LoRaWAN protocol,<br />
and a cloud analytics and<br />
alerting platform. The whole system<br />
has been designed to overcome<br />
the overarching constraints<br />
of the lack of power and connectivity<br />
in forests.<br />
Dryad’s Silvanet<br />
Wildfire Sensor<br />
is designed to<br />
operate for up<br />
to 15 years from<br />
onboard solar<br />
cells.<br />
source ©: Cision<br />
The Silvanet Wildfire<br />
Sensor<br />
The sensing node for Silvanet is a<br />
solar-powered device that uses a<br />
sensor to measure temperature,<br />
humidity, and air pressure, as well<br />
as the concentrations of gases including<br />
hydrogen, carbon monoxide,<br />
carbon dioxide and volatile<br />
organic compounds at sensitivities<br />
of parts per million. A lowpower<br />
microcontroller, which integrates<br />
support for the LoRaWAN<br />
protocol, runs algorithms based<br />
on machine-learning (ML) strategies<br />
to process sensor data to reduce<br />
the energy burden of communicating<br />
it in raw form over the<br />
LoRaWAN RF network.<br />
The Wildfire Sensor is designed<br />
to run for up to 15 years without<br />
maintenance or a battery, which<br />
avoids introducing potentially<br />
flammable materials such as lithium<br />
into the forest.<br />
Silvanet is<br />
de signed to overcome<br />
the constraints<br />
of the lack<br />
of power and connectivity<br />
in forests.<br />
Carsten Brinkschulte<br />
Dryad Networks<br />
The Silvanet Mesh Gateway<br />
The Silvanet Mesh Gateway uses<br />
a LoRa concentrator chipset to<br />
implement the low-power, low<br />
data-rate LoRaWAN protocol,<br />
which is used to communicate<br />
with the Silvanet Wildfire Sensors<br />
and with third-party sensors that<br />
properly implement the standard.<br />
LoRaWANs usually have a star architecture,<br />
in which each end-node<br />
device, such as the Wildfire Sensor,<br />
has a direct relationship with the<br />
LoRaWAN gateway and through<br />
it to the internet. Although this<br />
approach is simple and widely<br />
implemented, it limits the reach<br />
of LoRaWAN networks to a circle<br />
whose radius is defined by the RF<br />
range from node to gateway. This,<br />
in turn, limits how far a LoRaWAN<br />
network can reach into a forest and<br />
hence its utility for early fire detection<br />
over large areas.<br />
Dryad’s key innovation is to extend<br />
the LoRaWAN with proprietary<br />
technology that links the<br />
gateways to each other to form<br />
a mesh of star networks, which<br />
together can reach much more<br />
deeply into a forest. The Silvanet<br />
Mesh Gateways are also solarpowered<br />
and designed to be<br />
mounted on trees at about three<br />
metres above the ground.<br />
Carsten Brinkschulte, CEO of Dryad,<br />
said: “The mesh is the magic<br />
of what we're doing. Standard<br />
LoRaWAN has a star network architecture<br />
so you can buy dozens<br />
of LoRa gateways, but they<br />
all have one problem. They all<br />
need to be connected directly<br />
to the internet. We place a mesh<br />
gateway every three kilometres<br />
which extends the coverage of<br />
the LoRaWAN network deep into<br />
the forest. Then we have a pro-<br />
source ©: Dryad Networks<br />
68
prietary protocol to connect from<br />
mesh gateway to mesh gateway.”<br />
The Silvanet Border<br />
Gateway<br />
Silvanet WildFire Sensors and Silvanet<br />
Mesh Gateways together<br />
can create an extensive ‘Internet<br />
of Trees’ among themselves, but<br />
they need a Silvanet Border Gateway<br />
to reach the wider internet.<br />
The Silvanet Border Gateway is designed<br />
to be placed at the edge of<br />
the forest, perhaps in a visitor’s car<br />
park or nearby building, to link the<br />
mesh network to the wider internet<br />
and then on to the Silvanet Cloud<br />
Platform. Each Border Gateway can<br />
act as a LoRa gateway, using the<br />
LoRa concentrator chipset. It can<br />
also implement 4G connectivity<br />
using the LTE-M standard and fall<br />
back to 2G and GPRS protocols if<br />
necessary. For even more remote<br />
deployments, the Silvanet Border<br />
Gateway can connect to the internet<br />
using the SWARM satellite network.<br />
The Border Gateway can be powered<br />
by solar cells, if necessary,<br />
although there is also support for<br />
wired power and Ethernet connectivity<br />
if that is available at the<br />
border site.<br />
The Silvanet Cloud Platform<br />
The sensor nodes, mesh networks<br />
and gateways are designed to<br />
bring pre-processed data from<br />
throughout the forest to the<br />
Silvanet Cloud Platform, which<br />
provides a complete solution for<br />
wildfire detection and monitoring<br />
the health and growth of the<br />
forest. The Silvanet application<br />
groups sensor devices and gateways<br />
either by geographical area,<br />
or by characteristics. Details related<br />
to each sensor, especially their<br />
fire status, are shown on a map.<br />
source ©: Dryad Networks<br />
The Silvanet Mesh<br />
Gateway<br />
connects multiple<br />
LoRa star networks<br />
into a daisy-chain<br />
with greater reach.<br />
The Engineering Challenge<br />
Dryad has an experienced team<br />
of founders with a wide variety of<br />
relevant skills but implementing<br />
Silvanet is still a challenge. Along<br />
with the hardware, it includes firmware<br />
development for energy-constrained<br />
data analytics, support for<br />
over-the-air updates, IoT security,<br />
implementing the LoRaWAN and<br />
ensuring standards compliance,<br />
creating the proprietary links between<br />
Mesh Gateways, integrating<br />
multiple forms of RF connectivity<br />
in the Border Gateways, and the<br />
cloud platform and analytics. All<br />
this must be achieved in equipment<br />
working at low power, with<br />
solar panels that are often in shade,<br />
in the difficult RF environment of a<br />
forest, and with the ruggedness to<br />
ensure long operating lifetimes.<br />
And, especially for the Wildfire Sensors,<br />
it must be done at the lowest<br />
possible cost to enable wide deployment.<br />
Brinkschulte says: “If you want to<br />
put something else on the list, RF<br />
communications in the forest is<br />
challenging because every tree is<br />
an obstruction full of water that<br />
absorbs radio waves.”<br />
There are other challenges with<br />
the RF implementation. Both<br />
69
<strong>Smart</strong> Lifestyle IoT and Fighting Forest Fires<br />
the LoRaWAN and the 4G radios<br />
in the Border Gateways must be<br />
on all the time because they must<br />
be ready to accept data from the<br />
Wildfire nodes or inbound messages<br />
from the cloud. If 4G LTE-M<br />
connectivity is unavailable, falling<br />
back to 2G protocols also boosts<br />
power consumption.<br />
“A key challenge for us is the ultralow<br />
power design of the sensor<br />
Whispering Forests<br />
The Silvanet Border<br />
Gateway brokers<br />
communication<br />
between the mesh of<br />
LoRa networks and<br />
the internet.<br />
hardware,” says Brinkschulte. “We<br />
need to work in an environment<br />
where we have very little energy<br />
input, yet we have to do something<br />
complex. We need to scan for gas<br />
compositions and run ML software,<br />
it needs to work reliably, and we<br />
need to detect fires very quickly.<br />
These are contradicting goals, and<br />
so one challenge is to select the<br />
right ultra-low power components.<br />
“At the same time, price is key<br />
because we will need to put hundreds<br />
of thousands if not millions<br />
of Wildfire Sensors in a forest for<br />
the system to work, and the price<br />
of each component at that scale<br />
determines the system cost. We<br />
can’t choose a component that<br />
performs extremely well but<br />
pushes the Bill of Material up by<br />
five euro and kills the product.”<br />
source ©: Dryad Networks<br />
Partnering for<br />
Market Insights<br />
Dryad has worked with Avnet<br />
Silica to explore its options for<br />
components that can meet these<br />
tough challenges.<br />
For example, the initial design<br />
uses a single- and dual-core microcontroller<br />
which offers ultra-low<br />
power operation and integrates<br />
LoRa radio, while having the performance<br />
to analyse sensor data<br />
with enough sophistication to detect<br />
wildfires early, without creating<br />
false positives.<br />
“We have to do that in the sensor<br />
because we do not have enough<br />
bandwidth to transmit all of the<br />
sensor data to the analytics in the<br />
cloud,” according to Brinkschulte.<br />
“We really appreciate the competent<br />
discussions we're having<br />
with Avnet Silica. They are bringing<br />
a lot of ideas and proposals for<br />
components which may optimise<br />
the performance of the system.”<br />
Dryad is already looking at potential<br />
optimisations of the hardware<br />
designs with even lower power<br />
and even lower costs, “and that's<br />
a constant discussion that we're<br />
having on which chipsets to use.<br />
We need to have it at really low<br />
cost and ultra-low power because<br />
if you halve the power consumption<br />
of the device you can halve<br />
the size of the solar panel and<br />
energy storage, which are key<br />
price-driving factors of the sensor<br />
node”, Brinkschulte notes.<br />
Dryad is using super-capacitors to<br />
store energy from the solar cells,<br />
rather than introducing potentially<br />
toxic and flammable rechargeable<br />
batteries into the forest.<br />
70
The network architecture of Silvanet<br />
source ©: Dryad Networks<br />
“If you can reduce power consumption<br />
you can reduce the<br />
capacity of the super-capacitors,<br />
which would also drive down the<br />
price. Super-capacitors are not yet<br />
commoditised, and so selecting<br />
the right components is definitely<br />
something where Avnet Silica has<br />
the competency to advise us on selecting<br />
which may perform better,<br />
have better availability, or a better<br />
price.”<br />
Dryad’s use of the parts is also a<br />
little unconventional in that supercapacitors<br />
are more widely used<br />
to provide enough energy to enable<br />
systems that have suddenly<br />
lost mains power to do an orderly<br />
shutdown.<br />
“There's lots of specific things that<br />
we need to do to charge the super-capacitors<br />
from the solar cell,<br />
so we need charging circuits that<br />
actually do that and that is a bit<br />
more challenging because it's not<br />
the standard way of doing things,”<br />
Brinkschulte adds.<br />
Avnet Silica is also helping Dryad<br />
understand current supply constraints<br />
for various parts, caused<br />
by supply-chain issues ranging<br />
source ©: Avnet Silica<br />
from the pandemic through to<br />
factory fires. It has been trying to<br />
ensure that Dryad chooses components<br />
that will be available in<br />
enough volume to allow it to roll<br />
out Wildfire Sensors and Gateways<br />
in volume.<br />
“When you move to your go-tomarket<br />
strategy and try to roll<br />
out your network and the quantity<br />
goes up, you need to have the<br />
microcontrollers and other parts<br />
delivered on time,” says Ingo Seehagen,<br />
senior field application engineer<br />
at Avnet Silica.<br />
From Tree<br />
to Tree<br />
The network<br />
architecture of<br />
Silvanet<br />
When you roll<br />
out your network,<br />
you need<br />
to have your<br />
parts delivered<br />
on time.<br />
Ingo Seehagen<br />
Senior field application<br />
engineer at Avnet Silica<br />
Dryad’s Vision<br />
According to Brinkschulte, wildfire<br />
sensing is just the first application<br />
of the Dryad networking technology.<br />
“This is a generic IoT communications<br />
infrastructure for the forest.<br />
There are tons of applications that<br />
forestry can benefit from once our<br />
infrastructure is in place. Soil moisture<br />
is one of them, tree growth,<br />
sap flow, anti-logging alerts using<br />
sound detection, and emergency<br />
communication for forest workers.”<br />
Forestry equipment maker Stihl is<br />
one of Dryad’s backers. “We create<br />
an IoT network infrastructure that<br />
digitises the forestry industry, and<br />
I guess that's of strategic interest<br />
to them,” says Brinkschulte.<br />
The deal also gives Dryad access to<br />
Stihl’s electronics manufacturing<br />
services, and all the tacit knowledge<br />
and expertise it has in making<br />
rugged electronics for use in<br />
challenging environments.<br />
“That is an advantage for us because<br />
if the mothership uses them,<br />
and the baby uses it as well, that<br />
means they give us good attention.”<br />
71
<strong>Smart</strong> Lifestyle Mobile Services<br />
72
Mobile Services<br />
Taking 5G<br />
to the Max<br />
The pandemic has increased business and<br />
user reliance on mobile services and paved the way for 5G.<br />
But why is it still so difficult to predict<br />
how useful 5G will be?<br />
n By Tom Leddo*<br />
The return on<br />
investment<br />
of 5G for the<br />
operators is<br />
by no means<br />
certain.<br />
Timotheus Höttges<br />
CEO of Deutsche Telekom<br />
<strong>Smart</strong> cities, self-driving vehicles<br />
and advanced robotics<br />
are just the tip of the iceberg:<br />
there's no doubt that<br />
5G will radically change the world.<br />
As far back as 2017, Timotheus<br />
Höttges, the CEO of Deutsche<br />
Telekom, gave an estimate for a<br />
nationwide 5G network in Europe,<br />
saying that the costs could amount<br />
to €300 billion to €500 billion - for<br />
a product whose "return on investment"<br />
for the operators was by no<br />
means certain. Which responsible<br />
businessman would invest such<br />
sums without knowing if and how<br />
such an investment might pay off?<br />
The world is a different place<br />
today than it was before the<br />
COVID-19 lockdowns. Our dependence<br />
on wireless services<br />
has increased dramatically, as has<br />
the demand for more speed and<br />
bandwidth. It would be negligent<br />
to believe that mobile data<br />
traffic will decrease again as the<br />
vaccines roll out and the world<br />
returns to "normalcy." Slow networks<br />
have simply become unacceptable.<br />
All operators are working<br />
flat out to provide users with<br />
better, faster networks. In many<br />
ways, the pandemic has been the<br />
catalyst to accelerate 5G infrastructure<br />
and deployment.<br />
Short-term Impact<br />
Because it is an application-based<br />
technology, we won't know the<br />
full benefits of 5G until it is<br />
source ©: Deutsche Telekom AG<br />
*Tom Leddo is Chief Strategy Officer of MD7, a mobile infrastructure solutions company based in San Diego. 73
<strong>Smart</strong> Lifestyle Mobile Services<br />
7.6<br />
The 5G Readiness Index 2021: Europe is Falling behind<br />
6.1<br />
5.8 5.6 5.6 5.3 5.1 5.0 5.0 4.9 4.7 4.7 4.6<br />
4.3 4.1 4.0 4.0 3.9 3.7<br />
source ©: Deutsche Telekom source ©: Kearney analysis<br />
United States<br />
South Korea<br />
Norway<br />
Japan<br />
Singapore<br />
Switzerland<br />
Beamforming<br />
New aktive antenna technology brings better reception and higher data rates<br />
Passive antenna<br />
Active antenna<br />
Reception evenin<br />
outlying areas<br />
thanks to adjusted<br />
beam signal.<br />
Signals radiate<br />
evenly in all<br />
directions<br />
Signal weaker at<br />
the edge<br />
Individually<br />
controllable signals<br />
can be targeted<br />
Signal is just as strong in<br />
the peripheral area as in the center<br />
Client only uses<br />
telephone, requiring<br />
less bandwidth<br />
Finland<br />
Italy<br />
Unready in Europe<br />
The 5G Readiness Index<br />
reveals that Europe is<br />
falling behind. But 5G<br />
isn't just an upgrade, but<br />
a paragym shift that will<br />
unleash innovation and<br />
new business ideas leaving<br />
latecomers playing<br />
catch-up.<br />
Adjustable<br />
transmitting<br />
power<br />
Perfect coverage <br />
for every single customer<br />
(maximum cell throughput)<br />
China<br />
Netherlands<br />
Sweden<br />
Australia<br />
Denmark<br />
France<br />
tions will not disappear when<br />
the next generation of mobile is<br />
implemented. Rather, they will experience<br />
a performance boost under<br />
5G, such as faster downloads,<br />
improved streaming and gaming,<br />
or more reliable video conferencing.<br />
Mobile operators which can<br />
take advantage of this difference<br />
Horizontal and vertical<br />
antennaadjustment increases<br />
coverageespecially in urban areas<br />
withhighrise buildings.<br />
Signal is only<br />
transmitted<br />
when needed<br />
Client streams video<br />
at high data rates.<br />
Signal is adjusted as<br />
necessary<br />
Germany<br />
Spain<br />
United Kingdom<br />
Austria<br />
Belgium<br />
"here," which will take another<br />
five to ten years. Until then, we<br />
see two types of near-term impact:<br />
How existing applications<br />
work on 5G networks and how 5G<br />
impacts the economy even as it is<br />
being deployed.<br />
Even though 5G is applicationbased,<br />
today's mobile applicawill<br />
definitely be among the winners<br />
of the development.<br />
The other angle from which to<br />
look at the short-term impact of<br />
5G, is the benefit to the economy.<br />
According to a study conducted<br />
for the U.S. by the Boston Consulting<br />
Group, 5G will contribute<br />
between $400 billion and $500<br />
billion to the gross domestic<br />
product there and create up to<br />
one million new jobs by 2030.<br />
Even if these figures already seem<br />
impressive: The economic impact<br />
of a new mobile network has already<br />
been underestimated at<br />
least once. Studies at the beginning<br />
of 4G deployment, for example,<br />
assumed that investment<br />
in 4G networks in the U.S. would<br />
contribute about $73 billion to<br />
$151 billion to GDP from 2012<br />
to 2016 and create 371,000 to<br />
771,000 new jobs. By 2016, however,<br />
4G contributed nearly $445<br />
To Beam or not to Beam?<br />
Instead of emitting a mobile<br />
signal in a circular pattern,<br />
which then becomes weaker<br />
and weaker at the edges, as<br />
has been the case in the past,<br />
beamforming allows 5G signals<br />
to be targeted in the form of<br />
elongated lobes. This means<br />
that the transmission power can<br />
be adjusted as needed.<br />
74
The 5G Economy<br />
will go through three phases,<br />
says the Boston Consulting<br />
Group. Robust 5G networks<br />
will serve as the backbone<br />
of future economic growth.<br />
Rising 5G penetration rates<br />
will enable transformation in<br />
existing applications. Phase<br />
three will bring benefits to<br />
citizens and businesses<br />
including higher productivity,<br />
lower costs, and better health<br />
and safety.<br />
Broad<br />
benefits<br />
5G -enabled<br />
use cases<br />
5G will be the Foundation for Tomorrow's Economy<br />
A robust 5G network will bring significant direct benefits:<br />
• More data, more devices, and increased speed<br />
• A better network experience for US citizens and businesses<br />
source ©: Boston Consulting Group<br />
billion to GDP. Over the course<br />
of the "4G decade," more than 20<br />
million jobs were created in the<br />
U.S. alone.<br />
In this sense, the true impact of<br />
5G is likely to be much higher<br />
than we are currently outlining.<br />
A Look at the Potential<br />
While the near-term impact of 5G is<br />
quantifiable in terms of application<br />
performance and GDP growth, it<br />
still does not take into account the<br />
broader effect of the 5G ecosystem.<br />
For 5G to truly take hold, the<br />
industry must demonstrate the<br />
technology's "business case." Why<br />
else would investment continue to<br />
flow into the sector? How to develop<br />
use cases for 5G without using<br />
5G? It's the ultimate chicken-andegg<br />
scenario. So which comes first,<br />
the technology or the application?<br />
With 4G, it was the technology.<br />
Application versus network was<br />
never an issue with 4G because<br />
4G was content-driven. Consumers<br />
wanted faster speeds to<br />
stream movies, go online and<br />
generally use mobile Internet.<br />
However, while 4G was a big step<br />
Fixed Wireless<br />
Access<br />
Leveraging the improved speed and<br />
performance of 5G to offer broadband<br />
to homes and businesses<br />
Robust<br />
5G network<br />
The Different Rationales for Deploying 5G<br />
Enhanced<br />
Mobile<br />
Broadband<br />
Offering a better and more unique<br />
user experience-often including<br />
tailored content and services<br />
Near term<br />
forward for the way mobile users<br />
consume content, the technology<br />
didn't break through until<br />
the emergence of certain applications.<br />
Through them, developers<br />
learned what the technology<br />
could do and products and services<br />
emerged, such as Uber, that<br />
used 4G to transmit data and locations<br />
- and changed our lives.<br />
With 5G, it's very different. Unlike<br />
4G, 5G lacks a fundamental network<br />
for developers to even begin<br />
developing applications. That's<br />
because we don't yet know what<br />
5G can really do. We also don't<br />
know how applications will use<br />
the near-zero latency and IoT capabilities.<br />
As a result, it's impossible<br />
to assess the true impact of 5G.<br />
Network Cost<br />
Optimization<br />
Meeting network traffic demands in<br />
a more cost-effective manner than<br />
building new cell sites<br />
The business case depends on multiple factors, including market needs, technology options, the existing<br />
(and expected) competitive landscape, marketing strategies, and tailored content<br />
Who Will Lead in 5G?<br />
By the end of the 2G era,<br />
spectrum-related regulations<br />
increased licensing<br />
costs and delayed investment<br />
in 3G in Europe, so<br />
Japan dominated and<br />
was well-positioned to<br />
lead the 4G economy,<br />
too. During both the 2G<br />
and 3G eras, the US was<br />
slow to roll out networks.<br />
However, US regulators<br />
made important policy<br />
decisions, and by 2015,<br />
over 50 percent of adults<br />
in both the US and Japan<br />
had 4G subscriptions—a<br />
higher percentage than in<br />
most European countries.<br />
It remains to be seen who<br />
will lead the 5G revolution.<br />
New Use Cases<br />
Moving beyond core connectivity with<br />
newusecases(verticalor horizontal)<br />
and business models (mostly B2B and<br />
B2B2C)<br />
Long term<br />
5G-enabled use cases are key to building the 5G economy:<br />
• Extreme mobile broadband<br />
• Fixed wireless access<br />
• Massive loT (consumer wearables, logistics and tracking)<br />
• Mission-critical loT (e-health, connected vehicles)<br />
Broad societal benefits will include:<br />
• Improved productivity<br />
• Improved cost competitiveness for US companies<br />
• Improved health and safety<br />
The theoretical possibilities are<br />
endless. At its core, 5G is about real-time<br />
connectivity and connecting<br />
everything to everything – the<br />
basic promise of IoT, after all.<br />
Once the first business model is<br />
established that leverages the capabilities<br />
of 5G, the ROI will likely<br />
be greater than anyone is predicting<br />
today. Just as Uber created a<br />
ride-sharing market that would<br />
have been impossible without 4G,<br />
companies that listen wisely to<br />
their customers can find the next<br />
big niche with the help of 5G.<br />
The Next Big Thing<br />
Each new generation of technology<br />
has brought improvements<br />
with faster and more reliable connections.<br />
Since the introduction of<br />
4G/LTE, mobile has changed the<br />
way people work, live, get around,<br />
or spend their leisure time. But<br />
where those advances were already<br />
astronomical, 5G will far<br />
eclipse them. No one can predict<br />
what the future will bring, but the<br />
limitless potential of 5G is beyond<br />
question. All that remains to be<br />
seen is how, when, and by whom<br />
this technology's enormous potential<br />
will be fully realised.<br />
source ©: Boston Consulting Group<br />
75
<strong>Smart</strong> Lifestyle Interview: Chetan Khona<br />
I bet these last few months have<br />
been an exciting time to work for<br />
Xilinx.<br />
Yeah, Tim, it sure is. Recently,<br />
we’ve doubled down on our<br />
products geared for my segment<br />
of the market: industrial vision,<br />
healthcare and sciences. And, if<br />
you haven't noticed, we've announced<br />
about five years’ worth<br />
of products for industrial and<br />
healthcare IoT edge applications<br />
in the past few months.<br />
Interview<br />
The World<br />
is Shrinking<br />
Computer chips are more powerful and versatile than ever<br />
and they're getting smaller every day. A company making<br />
this happen is Xilinx, based in San Jose, California,<br />
and it is one from just a handful of innovators shaping<br />
the future of semiconductors. The inventor of the field<br />
programmable gate array (FPGA) has just been acquired<br />
by microprocessor giant AMD for the staggering sum<br />
of $35 billion. <strong>Smart</strong> <strong>Industry</strong> sat down with<br />
Chetan Khona, Director, Industrial, Vision,<br />
Healthcare & Sciences at AMD.<br />
n By Tim Cole *<br />
source ©: TIM Global Media BV<br />
So, you already have your work cut<br />
out for you for the next five years.<br />
Yes, absolutely. We just announced<br />
our cost-optimised portfolio<br />
at 16 nanometers, our Artix<br />
UltraScale+ in our extensions towards<br />
Zynq UltraScale+ devices<br />
that are amazingly popular in industrial<br />
healthcare IoT systems. In<br />
April of this year, we introduced<br />
our Kria system-on-modules that<br />
enable developers to programme<br />
and differentiate their designs at<br />
the software level, without requiring<br />
FPGA programming experience.<br />
Then, in June of this year,<br />
we announced our Versal AI edge<br />
products for people who don't<br />
really know what FPGAs are. It’s<br />
an Adaptive Compute Acceleration<br />
Platform (ACAP) for real-time<br />
systems in automated driving,<br />
predictive factory and healthcare<br />
systems, multi-mission payloads<br />
in aerospace and defense, and a<br />
breadth of other applications.<br />
Could you explain what role they<br />
play in the development of IoT systems?<br />
Sure, adaptive system-on-a-chip,<br />
or SoC FPGA for short, is what our<br />
Zynq and Zynq UltraScale+, and<br />
now our Versal AI edge devices<br />
offer: processing at the IoT edge,<br />
right at the analog digital boundary.<br />
They enable scalability from<br />
low to mid to high-end systems<br />
but also allow you to keep running<br />
software on a consistent<br />
Arm processing subsystem. In addition,<br />
they have customised acceleration<br />
blocks for a variety of<br />
76<br />
*Tim Cole is editor of <strong>Smart</strong> <strong>Industry</strong>.
applications ranging from things<br />
like electric drive to patient monitors<br />
and security cameras, all with<br />
the same device. We call this ‘platform<br />
design’ and platforms are<br />
critical to industrial and healthcare<br />
IoT design.<br />
What is FPGA DNA?<br />
When we say FPGA DNA, we are<br />
referring to the fact that, even<br />
though we have systems-onchips,<br />
what separates ours from<br />
traditional SoCs supplied by other<br />
semiconductor manufacturers<br />
is that, in addition the usual set<br />
of status-quo features, we also<br />
offer fabric FPGAs to go along<br />
with them. In the past, you’ve often<br />
seen a processor sitting next<br />
to an FPGA, now you essentially<br />
are getting the functions of both<br />
devices in one because we've<br />
brought the FPGA and the processor<br />
together under one hood.<br />
You mentioned platforms. Why are<br />
they critical in situations like this?<br />
Xilinx has identified a few key<br />
pieces that are used in virtually all<br />
industrial and healthcare IoT systems;<br />
things like functional safety,<br />
cybersecurity, connectivity, control,<br />
vision, mixed criticality, embedded<br />
software and edge AI. These are<br />
pieces that are used in almost all<br />
new industrial and healthcare IoT<br />
designs. If you have to start designing<br />
from scratch every time, you<br />
might have a product out by the<br />
end of the decade, so good luck to<br />
you! But the platform concept helps<br />
you to be more efficient by re-using<br />
blocks and leveraging your investment.<br />
When you mix the scalability<br />
of Xilinx SoCs with this platform in<br />
concept, you get what a lot of our<br />
customers would feel is a winning<br />
combination.<br />
The semiconductor world is moving<br />
quickly to things like miniaturisation,<br />
lower power, lightweight<br />
or even entirely wireless. What can<br />
Xilinx bring to the table here?<br />
You're so right! I mean, no one out<br />
there is selling products that are<br />
bigger, slower or require more<br />
power. The world in all aspects of<br />
life is moving to smaller, lighter,<br />
wireless and battery power. In the<br />
short term, there is this concept<br />
of compute density that we're<br />
really focused on. As more and<br />
more processing is moving to<br />
the extreme edge, to the analog/<br />
digital boundary, compute density<br />
increasingly becomes a bigger<br />
deal. That's something we've<br />
tapped into with InFO packaging<br />
in the cost-optimised portfolio<br />
extensions that we have just announced.<br />
Tell us something about integrated<br />
fan out. What is it and why should<br />
customers be interested?<br />
I wouldn’t recommend your readers<br />
try this at home but if you<br />
were to crack open your mobile<br />
phone – and maybe you have<br />
one, you know, with a fruit logo<br />
on it – you'll see examples of InFO<br />
packaging in action. Integrated<br />
fan out eliminates the substrate<br />
that acts as the interconnect between<br />
the dye and the balls that<br />
connect up to the printed circuit<br />
board. What this means is that<br />
you're getting the most compute<br />
density per square millimetre of<br />
any embedded processor on the<br />
planet without reducing IO count.<br />
Typically speaking, you're going<br />
to see 60 percent smaller size, 70<br />
percent lower height, with zero<br />
IO loss. Having that kind of computational<br />
horsepower in something<br />
smaller than the size of your<br />
fingernail is an absolute game<br />
changer for many industries.<br />
You know, that sounds like the end<br />
of the road for chip miniaturisation,<br />
doesn’t it? How can you possibly<br />
get any smaller?<br />
Well, this is independent from the<br />
natural scaling that takes place,<br />
right? Even though Moore's Law<br />
has slowed down slightly over<br />
time, that doesn't mean that geometries<br />
aren’t still shrinking.<br />
Right now, our 16 nanometer<br />
products are probably main-<br />
Just because<br />
Moore's Law<br />
has slowed<br />
down slightly<br />
doesn't mean<br />
geometries<br />
aren't still<br />
shrinking.<br />
Chetan Khona<br />
AMD<br />
stream for many applications, but<br />
we've announced products, many<br />
of which are already entering into<br />
full-ramp production, that work<br />
at seven nanometers, and the<br />
world is shrinking even more.<br />
If the dye shrinks even further,<br />
the InFO packaging will have to<br />
shrink along with it.<br />
You were personally involved in<br />
the Xilinx solution approach. What<br />
is your primary focus and what are<br />
your core vertical markets?<br />
At Xilinx, we have eight markets<br />
that we’re really focused on,<br />
namely wired and wireless communication,<br />
data centres, automotive,<br />
aerospace and defense,<br />
test and measurement, audiovideo<br />
broadcast, consumer<br />
electronics, and then my market<br />
which is industrial vision, healthcare<br />
and sciences which makes<br />
up almost 40 percent of the total<br />
number of customers Xilinx has<br />
out there.<br />
You are partnering with Avnet<br />
Silica, the sponsors of this magazine<br />
and the corresponding podcast,<br />
We Talk IoT, in which you’ve<br />
already appeared. What is Avnet’s<br />
role in your go-to-market process?<br />
As we touched on when you<br />
asked about the ecosystem, we're<br />
fortunate to have partners, and in<br />
this case Avnet Silica, as a close<br />
cooperative partner with whom<br />
we can generate clear value for<br />
customers on a daily basis. They<br />
do the distribution and financial<br />
services, support and upfront<br />
architectural advisement for customers’<br />
design services, from the<br />
chip to the board to connectivity<br />
to the cloud. They do the training<br />
and events that draw a lot<br />
of people, whether in person or,<br />
these days especially, online but<br />
most importantly for us, they're a<br />
trusted partner that our customers<br />
think of first and can count<br />
on even in such uncertain times.<br />
I would say they are the key player<br />
in my own business go-to-market<br />
process.<br />
77
<strong>Smart</strong> Solution Data Marketplaces<br />
Data Marketplaces<br />
Old Data for<br />
Sale<br />
Do you know what your data is worth? Many private<br />
companies and public sector organisations could be sitting on<br />
piles of money they could use for other purposes– but where can<br />
they go to buy, sell or exchange this ‘used’ data? Data exchanges<br />
are an exciting new frontier in the realm of Big Data.<br />
n By Stian Overdahl<br />
78
Data exchanges, or data<br />
marketplaces, could potentially<br />
unlock new revenue<br />
streams for companies,<br />
as well as lowering the cost of engaging<br />
in data-intensive activities,<br />
such as training machine-learning<br />
algorithms. Aside from exchanges,<br />
white label solutions for large corporates<br />
and their suppliers are another<br />
promising development.<br />
Any company can estimate the<br />
value of its data by calculating the<br />
cost of collecting it, its value to an<br />
internal commercial project, and<br />
its quality and longevity (will it<br />
have value in five years’ time?). In<br />
the era of data exchanges, these<br />
figures take on a new cogency<br />
as companies sell data sets, give<br />
them to trusted partners or acquire<br />
new data sets.<br />
Establishing a value for data on a<br />
public marketplace could bring<br />
big benefits to companies. For<br />
example, a project generating a<br />
significant amount of data could<br />
defray some of its costs by selling<br />
it, while a project where collection<br />
costs are significant could be done<br />
more cheaply by buying-in data.<br />
Sheridan Johns, head of ecosystem<br />
at Ocean Protocol, a blockchain-based<br />
data exchange, says,<br />
“People understand that data is<br />
valuable, and people are building<br />
valuable companies using data,<br />
but what are people going to<br />
pay for data? Putting data on our<br />
marketplace, allowing data to be<br />
Data<br />
Provider<br />
Compute<br />
Provider<br />
of digital and emerging technology<br />
at professional services firm EY.<br />
Buyers of raw data often find that<br />
suppliers collect and aggregate<br />
data in different ways and formats.<br />
A company that wants to<br />
provide a weather service, for example,<br />
can run into difficulties as<br />
it must obtain data from various<br />
measuring sites.<br />
It’s likely that a weather station<br />
run by a professional organisation,<br />
like an airport, would collect<br />
data more frequently, whereas<br />
others, such as a community organisation,<br />
would sample less frequently.<br />
In addition, the various<br />
measurers may calibrate their sensors<br />
differently. Maintenance can<br />
also be a factor – for example, one<br />
supplier may experience more<br />
downtime or it may decide to<br />
upgrade its software, making the<br />
data fragmented or unreadable.<br />
There are also questions about<br />
whether a company can build a<br />
product with a competitive advantage<br />
by relying on third-party data<br />
sources, or does it need to build its<br />
own sensing infrastructure?<br />
“In 99 percent of cases, you will<br />
recognise that the competipriced<br />
in real time using dynamic<br />
pricing features and automatic<br />
market makers, enables an individual<br />
or organisation to publish<br />
a certain dataset and determine<br />
exactly what its value is.”<br />
Johns believes that within ten<br />
years it’s going to be commonplace<br />
for large organisations to be<br />
either buyers or sellers of data using<br />
online data marketplaces. This<br />
potential growth will result from<br />
the growing need for data, especially<br />
for artificial intelligence.<br />
Increased demand and a growing<br />
awareness of the importance of<br />
data also makes companies more<br />
likely to share externally, notes Didier<br />
Navez, senior vice president of<br />
strategy and alliances at Dawex, a<br />
data exchange. “In the context of<br />
training AI, it seems like the market<br />
is evolving and maturing, and<br />
companies are really willing to<br />
share data. Clearly data exchanges<br />
help in that process because they<br />
provide a structured environment<br />
where exchange of data is secure<br />
and compliant,” he says.<br />
There are still several flies in the<br />
ointment, especially in the domain<br />
of IoT: quality of data, privacy<br />
and commercial sensitivities.<br />
"When it comes to monetisation<br />
of IoT data, people think it should<br />
be easy. Unfortunately, there are<br />
a couple of huge issues and this<br />
concept very quickly becomes<br />
very complicated,” says Aleksander<br />
Poniewierski, global head<br />
Decentralized Data Market Protocol and Network of AI Data / Servies<br />
Storage<br />
Provider<br />
Analytics<br />
People understand<br />
that data<br />
is valuable, but<br />
what are they<br />
going to pay?<br />
Sheridan Johns<br />
Ocean Protocol<br />
Further<br />
Processing<br />
source ©: New Work SE<br />
source ©: Asia Crypto Today<br />
Algorithm<br />
f(x)<br />
Curation<br />
Building a Data Ecosystem<br />
Through the help of decentralised service<br />
agreements and access controls powered<br />
by virtual machines, Ocean allows users<br />
to access, monetise, and even curate data<br />
management services that they will need<br />
for their businesses.<br />
79
<strong>Smart</strong> Solution Data Marketplaces<br />
tive advantage comes from building<br />
your own data infrastructure,<br />
rather than sourcing [externally],”<br />
says Poniewierski. If a company<br />
creates a business that relies on<br />
external data sources, then competitors<br />
might easily surpass it, he<br />
notes.<br />
Putting Data to Good Use<br />
Exchange operators embrace a<br />
range of different models, ranging<br />
from fully open data marketplaces,<br />
through restricted marketplaces<br />
or corporate internal data sharing<br />
platforms, to data brokers that will<br />
search for a data set on request.<br />
There is also the split between private<br />
and public sectors. For example,<br />
several public sector organisations<br />
have a mandate to share data<br />
sets and a marketplace is one way<br />
to make these more readily available.<br />
One such project, Gaia-X in<br />
Europe, envisages a marketplace<br />
to improve artificial intelligence<br />
product development, including a<br />
“protected data room for development<br />
and test data in order to continuously<br />
improve the AI applications<br />
and adapt them to customer<br />
needs”.<br />
Long-running fears about personal<br />
data privacy means there is now<br />
the potential for forming decentralised<br />
autonomous organisations<br />
80<br />
The advantage<br />
comes from<br />
building your<br />
own data infrastructure.<br />
Aleksander Poniewierski<br />
Global head of digital<br />
and emerging technology<br />
at EY<br />
Purchasing Platform<br />
<strong>Smart</strong> Contracts by<br />
Databroker DAO is a<br />
platform for listing,<br />
verifying, aggregating,<br />
enhancing and<br />
reselling data through<br />
a simple and intuitive<br />
user interface.<br />
(DAOs) where individuals could<br />
share their own anonymised data<br />
with others.<br />
“What we’re seeing emerging on<br />
the consumer front is the idea of<br />
data unions, or data DAOs, where<br />
individuals are encouraged to pool<br />
their data into one larger data set.<br />
Then, when that data set is used<br />
by the third party, the rewards are<br />
distributed to all of the individuals<br />
who helped to make it,” says Johns.<br />
source ©:EY / Ernst & Young Global Limited<br />
White-label solutions target organisations<br />
where commercial sensitivity,<br />
privacy and other concerns<br />
are top of mind. These allow data<br />
sets to be shared securely between<br />
business units within the organisation<br />
or with trusted supply-chain<br />
partners.<br />
In the enterprise segment, the advantages<br />
of sharing data may outweigh<br />
commercial sensitivities. In<br />
the German automotive industry,<br />
companies – including Mercedes-<br />
Benz, BMW and Volkswagen – are<br />
exploring the potential benefits<br />
of a data exchange programme.<br />
The goal is an open, scalable network<br />
for sharing cross-company,<br />
standardised information. As a<br />
technology partner, Ocean Protocol<br />
describes the basic concept as<br />
showing how competitive companies<br />
can benefit mutually by sharing<br />
data rather than building separate,<br />
proprietary, siloed services for<br />
themselves.<br />
Financial opportunities will depend<br />
on the value companies<br />
see in the data they obtain on exchanges,<br />
and what they’re willing<br />
to spend. In turn, that depends on<br />
how the data can improve business<br />
outcomes – and its quality.<br />
source ©: Medium
Interview<br />
Circular Reasoning<br />
What is Dawex?<br />
Dawex helps facilitate the circulation<br />
of data among various stakeholders.<br />
We are developing data<br />
exchange platforms that can be<br />
used by many different types of<br />
organisations, whether private or<br />
public.<br />
Why are data exchanges important?<br />
As you know, the world is seeing<br />
an explosion in data being created.<br />
IoT is part of the reason but,<br />
even though the supply of data is<br />
incredibly high – activities such<br />
as training a machine learning algorithm<br />
requires huge amounts<br />
of data – demand is increasing a<br />
lot, more than a single organisation<br />
can typically supply. Organisations<br />
need to look to external<br />
sources. Of course, you have open<br />
data, you can scrape the web and<br />
do things like that but very often<br />
the most important data are residing<br />
at other organisations – accessing<br />
that can be challenging,<br />
at least legally.<br />
So that’s where data exchanges<br />
come in?<br />
They connect the data suppliers<br />
with the data acquirers and help<br />
them engage. That requires trust.<br />
Elements that can create trust<br />
include being able to carry out a<br />
data transaction in a secure and<br />
regulatory compliant environment<br />
– something you can typically<br />
embed in a data exchange<br />
platform.<br />
Can I buy used data like I buy a<br />
used car? Does it belong to me?<br />
Data owners must consider<br />
whether they are ready to make<br />
their data available to others and,<br />
if so, on which terms and conditions,<br />
and at what price. Typically,<br />
data is licensed. Instead of buying<br />
the data outright, the buyer<br />
purchases a license which allow<br />
them to use it under certain<br />
terms and conditions. There are<br />
also many regulations governing<br />
data sales – not just private data,<br />
but any kind of data. We know of<br />
more than 120 pieces of regulation<br />
globally and our anticipation<br />
is that the data economy is going<br />
to be regulated as heavily as the<br />
financial markets – if not more so.<br />
What are the technical requirements?<br />
The actual sharing and transferring<br />
of data can happen in many<br />
ways: simple, file-based exchange<br />
or API-based; it can be a one-time<br />
transaction versus subscription<br />
or ongoing. With a subscription<br />
the user obtains access to data<br />
Data owners<br />
must always<br />
know who they<br />
are dealing<br />
with, who is<br />
using the data,<br />
and how it will<br />
be used.<br />
Didier Navez<br />
Dawex<br />
source ©: Dawex Systems<br />
for a certain period, with the data<br />
updated on a regular basis according<br />
to the agreement. The<br />
challenge and opportunity for<br />
the data exchange provider is to<br />
be able to keep track of, and cope<br />
with, all these use cases and scenarios.<br />
At Dawex, we manage all<br />
these issues, whether it’s a hedge<br />
fund making a one-off acquisition<br />
of a data set to test an algorithm,<br />
or on-going projects, for example<br />
in the agricultural sector and in<br />
the agri-foods industry.<br />
In September 2021, you joined<br />
a consortium of partners from<br />
the aerospace industry to create<br />
what you call the Space Data<br />
Marketplace. What is the rationale<br />
behind that?<br />
This project is focused on satellite<br />
data. Currently, the domain<br />
is quite siloed. There are multiple<br />
sources where you can get<br />
these data now but it’s neither<br />
very streamlined nor efficient. We<br />
want to create a one-stop shop<br />
for all types of satellite data for<br />
all kinds of use cases and initiatives.<br />
For example, we have companies<br />
developing solutions for<br />
analysing infrastructure using AI<br />
or looking at applications such<br />
as rail or waterways or managing<br />
crops and vegetation.<br />
What’s the difference between<br />
open exchanges and closed<br />
white-label ecosystems, and<br />
how do you see this playing out?<br />
A modern data exchange environment<br />
should push for transparency,<br />
so the data owner will always<br />
know who they are dealing with,<br />
who is using the data and how<br />
it will be used. That’s a very important<br />
principle for augmenting<br />
the trust that corporates have for<br />
making their own data available<br />
to others and, for example, avoiding<br />
the chance that a competitor<br />
would be able to access sensitive<br />
data they shouldn’t have.<br />
81
<strong>Smart</strong> Solution Machine Vision<br />
Machine Vision<br />
How to See<br />
the World<br />
Machines aren’t just becoming smarter every day –<br />
they are also developing the ability to see the world around them.<br />
In fact, artificial eyes can penetrate to greater depths and<br />
pick out much more detail than our weaker human eyes can<br />
ever hope to see. And yes, they can see in the dark, too.<br />
For IoT applications, this could be a real eye-opener.<br />
n By John Koon<br />
82
Light detection and ranging<br />
(Lidar) is a remote sensing<br />
method that uses pulsed laser<br />
light to measure ranges<br />
(variable distances). Similar to its<br />
close cousins, radar using radio<br />
waves and sonar emitting sound<br />
waves under water, Lidar uses laser<br />
light to accurately measure ranges<br />
(distances) – something that is critical<br />
for many sectors and industrial<br />
processes.<br />
Theoretically, measurement can be<br />
performed using other technologies,<br />
but Lidar has multiple advantages<br />
over them. For example, it has<br />
a higher resolution than radar and<br />
a wider range than camera sensors<br />
and can even perform in the dark.<br />
Furthermore, Lidar produces 3D<br />
data and can detect and differentiate<br />
objects. As a result, it can be used<br />
to track objects, detect physical protrusions<br />
and survey landscapes.<br />
Measuring carbon dioxide, sulfur<br />
dioxide and methane in the air or<br />
water can also be achieved with<br />
Lidar, making it ideal for things like<br />
geographical surveys, autonomous<br />
driving, industrial applications and<br />
logistics.<br />
source ©: NOAA<br />
The Face of the Earth<br />
Geographical surveys are not just<br />
for mapping mineral and water<br />
resources, they have been used to<br />
map zones prone to earthquakes,<br />
tsunamis, landslides, flooding and<br />
volcanic activity to deal with potential<br />
disasters. In addition, coastlines<br />
need to be surveyed for effective<br />
management and planning for<br />
navigational, environmental and<br />
homeland security purposes.<br />
As global warming raises sea levels<br />
and causes extreme weather events<br />
like enormous floods and droughts,<br />
high-resolution geographical surveys<br />
will be crucial for monitoring<br />
the effects of global warming, such<br />
as coastline erosion. This information<br />
can help governments to devise<br />
coping strategies, such as safe<br />
and responsible land use and emergency<br />
preparedness, to protect civilian<br />
lives and marine wildlife.<br />
The National Oceanic and Atmospheric<br />
Administration (NOAA), an<br />
agency primarily responsible for<br />
mapping US shorelines, sought to<br />
increase the efficiency and reduce<br />
the subjectivity of older technologies,<br />
such as tide coordinated aerial<br />
photography. Data collection in intertidal<br />
zones was also poor because<br />
these areas are too shallow for<br />
survey vessels to approach safely.<br />
NOAA now uses airplanes and helicopters<br />
equipped with two types of<br />
Lidar: topographic and bathymetric.<br />
Topographic Lidar typically uses a<br />
near-infrared laser to map the land,<br />
while bathymetric Lidar uses waterpenetrating<br />
green light to measure<br />
seafloor and riverbed elevations.<br />
Lidar is helping<br />
us understand<br />
sea-level rises<br />
and coastal<br />
flooding/inundation<br />
impacts,<br />
and marine life<br />
habitat mapping.<br />
Stephen White<br />
NOAA<br />
National Ocean Service<br />
Monitoring<br />
the Warming<br />
A view looking northeast<br />
from Virginia Key<br />
shows the topobathymetric<br />
surface of the<br />
intertidal zone near<br />
Fisher Island. This<br />
image was created<br />
from the LiDAR bare<br />
earth model colored<br />
by elevation.<br />
The two images can be combined to<br />
produce a single ‘topobathymetric’<br />
image of the coastal area.<br />
Driving Force<br />
How do we make sure autonomous<br />
cars and trucks pay proper attention<br />
and avoid disasters in near<br />
darkness, pouring rain, heavy snow<br />
or on a winding road?<br />
Lidar’s high speed and accuracy enable<br />
distant object detection on a<br />
moving vehicle, even in low light.<br />
This makes it a powerful technology<br />
for advanced driver-assistance<br />
systems (ADAS) in drones and vehicles.<br />
It performs less well in heavy<br />
rain and snow or in fog but work is<br />
in progress to find ways to improve<br />
its reliability in all but the worst conditions.<br />
Earlier Lidar technologies were<br />
typically used in applications with<br />
a high tolerance for failure. In contrast,<br />
the bar is much higher for<br />
safety, accuracy, and reliability<br />
when using it in autonomous vehicles.<br />
Products need to be designed<br />
from scratch to meet the 3D sensing<br />
requirements of automotive active<br />
safety systems, ADAS implementations<br />
and autonomous vehicles. In<br />
addition, solutions must be small<br />
and unobtrusive which is a challenge<br />
for Lidar.<br />
83<br />
source ©: NOAA
<strong>Smart</strong> Solution Machine Vision<br />
Aerial Mapping<br />
YellowScan uses<br />
a mix of dronemounted<br />
passive<br />
and active laser<br />
sensors to create<br />
3D maps for mining,<br />
civil engineering,<br />
forestry, environmental<br />
research,<br />
and archeology.<br />
Passive Sensor<br />
Active Sensor<br />
source ©: MicroVision<br />
source ©: YellowScan<br />
The scan rates and angles of the<br />
sensor need to be dynamically controlled<br />
and limiting the number of<br />
sensors used helps to decrease overall<br />
cost. It also minimises the amount<br />
of high-resolution data that must be<br />
collected and analysed on an often<br />
fast-moving and sporadically accelerating<br />
and decelerating vehicle.<br />
Vehicles need to<br />
see further out<br />
and understand<br />
more about<br />
what they see,<br />
such as which<br />
objects are<br />
moving and<br />
where are they<br />
heading.<br />
Jari Honkanen<br />
MicroVision<br />
The latest high-resolution 3D systems,<br />
such as MicroVision’s Long<br />
Range Automotive Lidar, meet stringent<br />
3D sensing requirements. They<br />
are compact and non-intrusive,<br />
with fast frame rates and can characterise<br />
an environment more accurately<br />
with a higher level of information<br />
analysis. These features enable<br />
vehicles to respond more rapidly to<br />
obstacles and avoid them.<br />
Making Things Work<br />
Industrial applications for Lidar include<br />
things like manufacturing<br />
and robotics automation. Systems,<br />
such as Baraja’s Spectrum-Scan, are<br />
being deployed in mining vehicles<br />
to map locations and visualise environments.<br />
It can also help improve<br />
worker safety in mines and caves.<br />
Mines are often located in remote<br />
areas and underground, where<br />
pockets of lethal gases tend to accumulate.<br />
Methane is explosive, carbon<br />
dioxide and carbon monoxide<br />
are lethal to humans at high concentrations,<br />
and hydrogen sulfide<br />
is poisonous and highly flammable.<br />
Therefore, using laser light to detect<br />
gas pockets allows miners to deal<br />
with them promptly, keeping them<br />
safe and making their time in the<br />
mine more efficient.<br />
Just as Lidars image the 3D topography<br />
of the environment for<br />
autonomous vehicles, they can be<br />
used above ground to detect unwanted<br />
gas concentrations during<br />
gas mapping. For example, a methane<br />
leak can be detected by pointing<br />
a laser beam of a specific color<br />
Loggerhead Lighthouse<br />
This image is a topobathymetric<br />
point cloud colorised<br />
by intensity. This image was<br />
captured during a survey of<br />
the Dry Tortugas, and is the<br />
lighthouse on Loggerhead Key.<br />
source ©: NOAA<br />
84
An Eye on the Road<br />
source ©: Bridger Photonics<br />
Scientists have approached the challenges<br />
of determining range, angleand<br />
velocity in two ways: using radio waves<br />
and using laser light. Lidar, radar and<br />
sonar each have their benefits and<br />
deficiencies in autonomous vehicles.<br />
Google’s spin-off company Waymo and<br />
Aurora, which took over Uber’s ill-fated<br />
project, both use Lidar but have radar<br />
for support in foggy, rainy or snowy<br />
conditions to assist Lidar’s less-reliable<br />
results in extreme weather. Tesla uses<br />
ultrasonic sonar to map the environment<br />
and a front-facing radar.<br />
A Sentry in the Sky<br />
At least 2 percent of gas<br />
resources is wasted through<br />
leaks of methane. A drone-based<br />
laser-based Remote Methane<br />
Leak Detector (RMLD) by Physical<br />
Sciences might solve the problem.<br />
at the suspected location or along<br />
a survey line. Some of the laser<br />
light is absorbed by the target gas<br />
and the rest bounces back as a diffused<br />
beam. The Lidar receives the<br />
reflected beam, measures the light<br />
absorption and calculates the density<br />
of the leaking methane.<br />
This process generates geo-specific<br />
images of gas plumes that can be<br />
combined with satellite and other<br />
data to create a map illustrating the<br />
leak’s extent and location. The GPS<br />
coordinates of the map can quickly<br />
direct a maintenance crew to the<br />
leak. So far, ExxonMobil and SoCal-<br />
Gas have used Lidar gas-mapping<br />
technology to detect leaks.<br />
source ©: Baraja<br />
What Will the Future Bring?<br />
In all cases, high-definition cameras<br />
supplement and complement the<br />
other systems to add visual context.<br />
The color cameras also provide the<br />
ability to monitor traffic lights and<br />
read road signs, which is beyond<br />
the other three sensors. This is useful<br />
where emergency signs have<br />
been put out by emergency services<br />
or for roadworks that may not be<br />
mapped on satnav systems.<br />
Lidar sensors are being developed<br />
that are even more miniaturised<br />
and lighter so they can be used for<br />
unmanned aerial systems, such as<br />
drones performing geographical<br />
surveys. Meanwhile, reducing costs,<br />
increasing reliability and enhancing<br />
data resolution will be common<br />
goals for the next generation.<br />
We are also likely to see further democratisation<br />
of Lidar applications.<br />
For example, the low-performance<br />
3D Lidars appearing in smartphones<br />
are likely to be replaced by<br />
ones with higher resolution and<br />
processing. In short, Lidar will be<br />
more compact, more capable and<br />
lower cost.<br />
Lidar systems<br />
can accurately<br />
map and visualise<br />
surrounding<br />
hazardous environments<br />
increasing<br />
safety<br />
and efficiency.<br />
Jim Kane<br />
Baraja Industries<br />
■ Radar<br />
Radio detection and ranging, coupled<br />
with hi-res cameras, is an approved way<br />
for providing machines with ‘sight’. In<br />
1886, German physicist Heinrich Hertz<br />
demonstrated that radio waves are reflected<br />
by metallic objects. British scientists,<br />
spurred on by the militarization of<br />
Germany, used this property to develop<br />
radio-based detection and ranging in<br />
1935. Independently, Germany, the USA<br />
and Russia also developed radar systems<br />
in the following year or two. These<br />
systems were all designed to detect<br />
huge hunks of metal at sea or in the air<br />
and in the years since then refinements<br />
have been made to finesse the detection<br />
capabilities to include all manner of<br />
objects, including humans.<br />
■ Lidar<br />
In 1960 the invention of laser technology<br />
created a flurry of research<br />
activity to find uses for the powerful<br />
light beams. In 1961, a US scientist<br />
named Malcom Stitch, who worked<br />
for the Hughes Aircraft Corporation,<br />
introduced the first functional Lidar<br />
system but it wasn’t until the arrival of a<br />
commercially available global positioning<br />
system (GPS) using satellites and<br />
inertial measurement units (IMUs) in<br />
the late 1980s that accurate positional<br />
data became available.Lidar’s reach is<br />
constantly increasing. Currently, Aeva,<br />
based in Silicon Valley, is selling its 4D<br />
Lidar system on-a-chip which has a<br />
range of 500m.<br />
85
Column Bernd Schöne<br />
Liquid Software<br />
Wetware Revisited<br />
There was a time when ‘wetware’ was a<br />
geek word for the part of the body<br />
that computer scientists use to<br />
gather and modify their thoughts.<br />
But jargon moves on and the new<br />
buzzword is ‘liquid software’, which<br />
stands for a system that can be updated<br />
and modified at any time without<br />
interrupting its flow. So, it isn’t all that<br />
different from wetware, is it?<br />
Agreeing on a definition for the new<br />
buzzword, on the other hand, is tricky. If<br />
you ask me, it simply represents a cautious<br />
step forward, albeit in the right general direction,<br />
with many more to follow.<br />
Software for IoT has very specific requirements. The<br />
market is fast-moving, unit volumes are high, and<br />
prices are manageable. The need to transfer large<br />
amounts of data across device and network boundaries<br />
is essential – as is the distribution of updates.<br />
Without software that is up-to-date, seamless interaction<br />
between sensors (acquiring data), data centres<br />
(crunching data), decision-makers (evaluating<br />
data) and actuators (controlling data) is impossible<br />
– and, without it, so is IoT. It comes as no surprise that<br />
the concept of ‘liquid’ has caused quite a flurry since<br />
its introduction to IT in 2014, even though, or maybe<br />
because, no one can say precisely what it is.<br />
The water analogy helps us understand what it is<br />
everybody’s talking about – and why they’re so excited.<br />
Just as water will always find its way to a river<br />
Dams and dikes<br />
are barriers<br />
that keep water –<br />
and data – from<br />
flowing freely.<br />
Bernd Schöne<br />
is a veteran German Internet<br />
journalist and an expert on<br />
cybersecurity<br />
and the sea, data and applications should be<br />
able to flow steadily and independently to<br />
where they are needed throughout the<br />
IoT network. The latest software versions<br />
running individual IoT components<br />
should autonomously go with<br />
the flow, with error corrections and<br />
new features being automatically<br />
patched-in on the way.<br />
This is not a new concept. The internet<br />
itself, and the World Wide Web, have<br />
been connecting computer systems for<br />
years, and ‘patch days’ are as old as the<br />
first servers. Before now, automatic updates<br />
were always instigated by specific applications,<br />
such as a browser or an email programme.<br />
Everything else required actions by the user. That's<br />
about to change. In the future, streams of data, applications<br />
and updates will find their own way to<br />
their destinations without a single click of a mouse.<br />
So far so good but experience has taught us that<br />
where liquid flows are concerned, dikes and weirs<br />
are essential to the successful co-existence of water<br />
and people. No one knows this better than the<br />
inhabitants of Europe, who were hit by horrendous<br />
flooding in 2021. The Dutch know better than most<br />
how to handle water: After a devastating storm<br />
surge in 1953, they sealed off the entire country from<br />
the North Sea within 30 years.<br />
Weirs and dikes are barriers that keep water – and<br />
data – from flowing freely and out of control. In IT,<br />
86
malware and substandard sets of data play the role<br />
of storm surges and floods. They must be contained.<br />
Even today, there are already such barriers in place in<br />
many companies but these ‘dikes’ are usually there<br />
for economic reasons. Apple and Google, both pioneers<br />
of the liquid software idea, with products like<br />
Apple's Handoff (Continuity) service and Android’s<br />
Lollipop, are fighting doggedly for market share –<br />
but the days of data monopolies are over.<br />
Keeping your users locked up within the walls of<br />
your own company network is the direct opposite<br />
of liquid software. It takes away the key advantages<br />
for the user and puts the whole idea of liquidity in<br />
danger.<br />
In my opinion, IoT dams and weirs should not be<br />
built by stock market analysts and CEOs, but by CTOs.<br />
There should be a coherent technical need for barriers<br />
to minimise security issues. Sandboxing of unknown<br />
data is one way to minimise risks but clear requirements<br />
for structure and security checks for incoming<br />
updates and new applications would also help.<br />
Technically, this is no longer a problem for machine<br />
tools whose AI intelligence always assumes a defect<br />
is imminent, based on conspicuous fluctuations in<br />
measured parameters. These predictive systems can<br />
not only inform service departments, without being<br />
told to do so, but can also automatically determine<br />
the availability of spare parts and the maintenance<br />
personnel waiting in the background. Edge systems<br />
can then autonomously calculate the team’s arrival<br />
time and determine when things will be running<br />
smoothly once again. All this without the maintenance<br />
or security teams needing to pick up the<br />
phone or for an employee to send an email to alert<br />
them.<br />
The IT support world is full of data: information about<br />
traffic flow, the number of service vehicles on standby,<br />
the location and condition of necessary spare or<br />
replacement parts. All we need to do is unlock this<br />
treasure trove of information and let the data flow.<br />
When that happens, we’ll be amazed to find what opportunities<br />
we’ve been missing just because phone<br />
providers, internet service providers, equipment<br />
manufacturers and operators, service companies,<br />
and application distributors have been jealously<br />
protecting their sinecures instead of networking in a<br />
purposeful way.<br />
Today, service technicians have to identify themselves<br />
to the gatekeeper, even though their IDs may<br />
have been established long ago and the exact time<br />
of their visits would already have been noted in all<br />
the company's IT systems. Unfortunately, gatekeepers<br />
don’t know any of this. Too bad!<br />
Of course, nobody should jump blindly into the flow.<br />
As always, prudence and precautions are necessary.<br />
New management tools, like ‘scrum’ software which<br />
helps teams to learn from shared experiences, will<br />
make IT security easier to achieve – there’s still no<br />
substitute for the human brain if we want to take IoT<br />
to the next level. In the end, it means that someone<br />
has to accept responsibility for any system. But as for<br />
the software? Just let it flow.<br />
87
<strong>Smart</strong> Solutions <strong>Smart</strong> Sensors<br />
<strong>Smart</strong> Sensors<br />
<strong>Smart</strong> Eyes for IoT<br />
Technicians have been reluctant to<br />
use cameras for IoT because they were<br />
considered too expensive. That is now<br />
history. Today, CMOS sensors with<br />
respectable resolution cost only a<br />
few dollars and chips that deliver<br />
high-definition images are available<br />
for a little more. Thanks to AI, new<br />
integrated image signal processors<br />
(ISPs) are taking the strain off transmission<br />
networks and edge computing.<br />
88<br />
n By Bernd Schöne<br />
Cameras provide lots of data<br />
and the more data, the better<br />
they are. Unfortunately,<br />
that clogs up the communications<br />
channels. In addition, the<br />
images have to be prepared and<br />
processed which puts a strain on the<br />
computers in the system. Often, the<br />
normal TV frame rate of around 25<br />
frames per second is not enough, either.<br />
Manufacturing machines operate<br />
so fast that surveillance cameras<br />
have to deliver 60 or more images<br />
per second. Thanks to data reduction,<br />
the H.265 transmission format<br />
shrinks the amount of data and thus<br />
enables wireless operation – but<br />
H.265 is computationally expensive,<br />
which is a shortcoming for batterypowered<br />
devices.<br />
CMOS chips also have peculiarities.<br />
Most sensors produce a certain<br />
basic noise level, even in absolute<br />
darkness. These chips also inevitably<br />
contain a few defective pixels.<br />
No problem – there are correction<br />
programmes for that. In addition,<br />
the distances between camera and<br />
object are often small in IoT applications.<br />
Also, no problem – that's what<br />
wide-angle lenses are for, though<br />
they do tend to distort and suffer<br />
from vignette shadowing around<br />
the edges.<br />
If the image analysis determines<br />
whether labels on a bottle are correctly<br />
positioned, for example, image<br />
errors can confuse and deceive<br />
the analysis programme. Here, too,<br />
there are proven remedies. However,<br />
correction programmes put a<br />
strain on the camera CPUs because<br />
the correction is best done before<br />
the image has been compressed in<br />
order to achieve optimum results.<br />
This, in turn, puts further strain on<br />
the communications channels.<br />
Usually, in cheaper systems, the<br />
black-and-white image of the sensor<br />
has to be transformed into a color<br />
image. For this purpose, the mosaiclike<br />
pattern of color filters over the
Qoitech<br />
Fighting Power Hunger<br />
source ©: Qoitech AB, Elektor Verlag GmbH<br />
camera sensor has to be back-calculated,<br />
so to speak, in order to obtain<br />
red/green/blue color separations<br />
(demosaicing). This also costs computing<br />
power.<br />
A new generation of image signal<br />
processors (ISPs) now offers developers<br />
a solution to these problems.<br />
ISPs operate in the immediate vicinity<br />
of the camera module and handle<br />
all the pre-processing of the images.<br />
They are calibrated to the chip and<br />
its optics and transform the raw data<br />
into images that can be easily processed<br />
further.<br />
In reality, no one is interested in<br />
the camera images, only the results<br />
count – thumbs up or thumbs<br />
down. In the labeling example, the<br />
operator wants to know if the label<br />
is positioned correctly: is it crooked<br />
or, in the case of pharmaceuticals, is<br />
it stuck together in such a way that<br />
it’s no longer legible? When cleaning<br />
bottles, no one is interested in<br />
the 100,000 bottles that have been<br />
cleaned well but only in those that<br />
need to be cleaned again or belong<br />
in the waste because they have a<br />
crack.<br />
Today, AI can take over these relatively<br />
simple tasks and the new ISPs<br />
also have a neural network on board<br />
that runs an AI programme for image<br />
analysis. In this way, the engineers<br />
can let them make their own<br />
decisions without the need for cloud<br />
support or data flow gymnastics.<br />
Most IoT devices are battery powered but<br />
designers want to know how power consumption<br />
will fare over time. Finnish startup Qoitech<br />
has launched the Otii Arc, an inexpensive ‘little<br />
helper’ that makes it possible to precisely<br />
track current, voltage and power consumption<br />
before a device is deployed.<br />
All batteries react the same way to load – the<br />
voltage output plummets. Unlike a flashlight,<br />
an IoT sensor does not load the battery evenly.<br />
Sometimes the sensor is ‘asleep’ and consumes<br />
no energy, sometimes it sends data and<br />
consumption skyrockets for a short time. Decisive<br />
for the load profile is the software, which<br />
may or may not be cleverly written, and the<br />
environment, especially the temperature. The<br />
Otii Arc measuring device connects directly<br />
to the sensor and a laptop. It acts as a power<br />
Fraunhofer<br />
How to Bee a Sensor<br />
What does a bee need to survive? Dramatically<br />
declining populations spurred the German<br />
government to have special sensors developed.<br />
In response, researchers at Fraunhofer<br />
source ©: Micro-Sensys GmbH<br />
source and determines the load profile over<br />
the operating time until the dreaded ‘brownout’<br />
as the battery empties.<br />
Qoitech’s device allows small development<br />
offices to carry out their own measurements<br />
and tests at a high technical level. The target<br />
groups also include software developers because<br />
the more cleverly the software manages<br />
the energy reserves, the longer the sensor<br />
battery will last. Programmers can now conveniently<br />
and quickly determine the success of<br />
their efforts without having to rely on lab tests<br />
from engineering firms.<br />
Determining battery runtimes is not the easiest<br />
of tasks. Within a few months of the launch,<br />
Qoitech received a number of requests and<br />
suggestions from users, which it rapidly incorporated<br />
in a software update.<br />
IZM created ultralight wireless sensors that can<br />
be attached to a bee's back, turning the insect<br />
into a flying IoT sensor. The RFID chip transmits<br />
important flight data as well as temperature<br />
and brightness to a base station. The system,<br />
which weighs only ten milligrams, is powered<br />
by a specially developed ultra-light battery<br />
which receives its energy from a microscopic<br />
solar module.<br />
In the medium term, the Sens4Bee project,<br />
based at Fraunhofer’s Helmholtz Centre for<br />
Environmental Research (UFZ) is to become a<br />
tool for all interested beekeepers. The aim is to<br />
clarify the relationship between bee mortality<br />
and the application of pesticides.<br />
89
<strong>Smart</strong> Solutions <strong>Smart</strong> Companies<br />
<strong>Smart</strong><br />
Companies<br />
Robotics Research<br />
Automated Rapid Transit<br />
A growing list of IoT innovations<br />
have been developed and<br />
deployed by companies which<br />
are using IoT to solve real-world<br />
problems in transport. Robotics<br />
Research’s AutoDrive advanced<br />
driver assistant system (ADAS)<br />
is one of these potentially revolutionary<br />
approaches to IoT. It is<br />
‘platform agnostic’ – meaning<br />
that it can be used to retrofit<br />
vehicles of all sizes, from small,<br />
portable robots to large trucks<br />
and buses. The system provides<br />
vehicles with autonomous driving<br />
functionality on surfaces<br />
ranging from urban-improved<br />
roads to off-road terrain, while<br />
also collecting and analysing<br />
data to enhance the driving experience.<br />
Robotic Research has deployed<br />
Society of Automotive Engineers<br />
(SAE) Level-Four automation<br />
where self-driving is supported<br />
only in limited spatial<br />
areas (geofenced) or under special<br />
circumstances. Outside of<br />
these situations, the vehicle will<br />
safely abort the trip by slowing<br />
down and parking the vehicle<br />
if the driver does not retake<br />
control. The AutoDrive technology<br />
is currently operating in 30<br />
states in the US and on four continents.<br />
Recently, the company has<br />
helped the Connecticut Department<br />
of Transportation to make<br />
source ©: New Flyer<br />
Electric Commute<br />
Flyer Xcelsior Charge<br />
heavy-duty transit buses<br />
are operating on the<br />
CTfastrak corridor, a<br />
dedicated nine-mile<br />
(14.5 km) stretch for exclusive<br />
use by CTtransit<br />
buses.<br />
advancements in automated<br />
public transit thanks to a new<br />
programme funded by the US<br />
Department of Transportation.<br />
Through the department’s Integrated<br />
Mobility Innovation (IMI)<br />
initiative, Robotic Research’s<br />
proprietary AutoDrive system<br />
is enabling the automation of<br />
heavy-duty transit buses for<br />
passenger service deployment.<br />
This will be a first for mass<br />
transportation systems in North<br />
America.<br />
Three automated New Flyer<br />
Xcelsior Charge heavy-duty<br />
transit buses are operating on<br />
the CTfastrak corridor, a dedicated<br />
nine-mile (14.5 km) stretch<br />
for exclusive use by CTtransit<br />
buses. The 40-foot, electric buses<br />
will offer a zero-emission operation<br />
running between New<br />
Britain and downtown Hartford,<br />
the capital of Connecticut.<br />
As the first automated Bus Rapid<br />
Transit line put into public service<br />
in North America, the CTtransit<br />
initiative also marks the<br />
first application of automated<br />
precision docking to optimise<br />
platform gaps. This, and other<br />
automated technology to improve<br />
access, ensures boarding<br />
is compliant with the Americans<br />
with Disabilities Act (1990)<br />
which prohibits discrimination<br />
based on disability, while increasing<br />
accessibility for all passengers.<br />
90
source ©: Space&Matter, Isabel Nabuurs Fotografie<br />
Space&Matter<br />
Launching A Floating<br />
Neighbourhood<br />
Climate change may force some<br />
city dwellers to take to the water.<br />
At least, that is the thinking at architects<br />
Space&Matter, founded<br />
in 2009 by Sascha Glasl, Tjeerd<br />
Haccou and Marthijn Pool. United<br />
by the desire to improve the world<br />
for their children and all future<br />
generations, their journey began<br />
with Water voor Wonen (Water for<br />
Living), a floating neighbourhood<br />
in the low-lying Dutch polder region.<br />
"Since urban areas struggle with<br />
high density, we should make better<br />
use of the space on the water,”<br />
says Haccou. Co-founder Glasl<br />
adds, “We want to set the example<br />
and show how living on water can<br />
be a great and better alternative<br />
for people and our planet."<br />
Their signature project, which<br />
began almost a decade ago but<br />
was only completed in the summer<br />
of 2021, is called Schoonschip<br />
– literally ‘clean ship’ in Dutch.<br />
Space&Matter says it was originally<br />
a “circular neighbourhood<br />
which was initiated and developed<br />
by a group of enthusiasts with a<br />
shared dream: to build a sustainable,<br />
close-knit community on the<br />
water”. The group approached the<br />
architecture firm to help design<br />
the urban plan, plotting the boardwalks<br />
and smart jetty that unite<br />
the inspired community.<br />
The project houses more than 100<br />
people in 46 sustainable homes<br />
across 30 water plots. The area<br />
was designed to be mainly selfsufficient,<br />
with a minimal impact<br />
on nature while adapting to the<br />
rising water.<br />
Schoonschip also uses clean<br />
energy sources, using solar<br />
Sascha Glasl<br />
is passionate about strategic<br />
design, innovative<br />
concepts and democratic<br />
development processes<br />
Tjeerd Haccou<br />
likes using online and offline<br />
tools to bring together and<br />
empower communities<br />
Marthijn Pool<br />
is excited about researchbased<br />
projects that explore<br />
new urban concepts<br />
panels and heat pumps to provide<br />
heating, and the architects<br />
plan to convert wastewater<br />
from toilets and showers into<br />
energy. All buildings also have<br />
a green roof – part vegetation<br />
and geared to rainwater collection.<br />
C40 Cities Climate Leadership<br />
Group, a collaboration between<br />
the mayors of 97 cities worldwide,<br />
agree that climate change<br />
may force many to choose to<br />
live on the water. It estimates<br />
that some 800 million people<br />
and 570 cities could be at risk<br />
by 2050 if sea levels rise by half<br />
a metre, as forecasted by some<br />
experts. C40 Cities – which represents<br />
a twelfth of the global<br />
population and a quarter of its<br />
economy – believes that the<br />
floating neighbourhood in Amsterdam,<br />
Netherlands, shows<br />
one way to cope.<br />
“Living on the water offers a<br />
great solution for places where<br />
climate change and a rise in sea<br />
levels are a looming hazard,”<br />
says Glasl. “It not only protects<br />
people against nature, it also<br />
protects nature itself.”<br />
91
<strong>Smart</strong> Lifestyle One More Thing<br />
And now:<br />
One More Thing<br />
For more than a year, the team at <strong>Smart</strong> <strong>Industry</strong>, the IoT Business<br />
Magazine, has been hosting a monthly series of podcasts<br />
called We Talk IoT. These consist of interviews with experts in the<br />
various areas of IoT who have something<br />
really important to say,<br />
n By Tim Cole<br />
92
The podcast covers a wide<br />
range of topics ranging from<br />
IoT infrastructure to autonomous<br />
vehicles, artificial intelligence,<br />
predictive analysis and<br />
cybersecurity. It is sponsored by<br />
Microsoft Azure and features on<br />
Spotify, Apple Podcasts and Sound-<br />
Cloud to reach an average audience<br />
of 5,000 to 6,000 listeners per<br />
month. We encourage our interview<br />
guests to link to the podcast from<br />
their own websites and social media<br />
platforms to boost overall listenership.<br />
If you would like to hear it, you<br />
can find it through our homepage at<br />
www.smart-industry.net/podcast.<br />
Every issue of We Talk IoT concludes<br />
with a short editorial item of interest<br />
which we call One More Thing. As of<br />
now, the editors will get to choose<br />
their favourite installments to share<br />
here at the end of our print edition.<br />
Foresolution<br />
Where’s the Loo? IoT<br />
Flushes It Out<br />
One of the most challenging jobs for<br />
IoT technologies is real-time tracking<br />
of goods and assets at remote locations,<br />
even when they lack a power<br />
source. Portable toilets are a good<br />
example. They’re usually tucked<br />
away well out of sight (and smell)<br />
and sometimes the only way to find<br />
them is to send out a search party.<br />
Foresolutions, a UK technology<br />
company, thinks it’s found a better<br />
way to locate and check the status<br />
of such hard-to-find assets as porta<br />
Mobile Expandable<br />
Wellbeing Unit<br />
Compacting to a 4ft<br />
(1.2 m) cube, the<br />
MEWU fits onto a<br />
standard rail trolley or<br />
trailer anywhere on<br />
track for deployment<br />
at the point of work.<br />
The Daily<br />
Travel Puzzle<br />
At Heathrow, as in<br />
any major airport,<br />
hundreds of companies<br />
work together<br />
to make travel<br />
safe and smooth.<br />
Increasinly, they<br />
rely on IoT to coordinate<br />
thousands of<br />
routine tasks, from<br />
toilete to air traffic<br />
control.<br />
potties, construction tools and airtraffic<br />
equipment, just to name a<br />
few. The company is providing battery-powered<br />
IoT devices along with<br />
its own software for managing nonpowered<br />
items in outdoor working<br />
environments.<br />
These often include seats of ease, euphemistically<br />
called Mobile Expandable<br />
Wellbeing Units, or MEWUs<br />
(pronounced ‘mews’). These are typically<br />
bright orange, interconnecting<br />
boxes placed at railway or building<br />
construction sites. They contain<br />
removable wastewater tanks and<br />
compartments for additional<br />
source ©: Selectequip source ©: Twitter / Heathrow Airport Limited<br />
93
<strong>Smart</strong> Lifestyle One More Thing<br />
source ©: Digital Matter<br />
Live Long and<br />
Prosper!<br />
Ultra-rugged longlife<br />
battery-powered<br />
GPS devices like this<br />
one from Digicore<br />
offer up to seven<br />
years of asset tracking,<br />
theft recovery,<br />
and more.<br />
IoT data<br />
keeps units<br />
sanitised<br />
and wellmaintained.<br />
Tom Ross<br />
Foresolutions<br />
safety equipment such as defibrillators<br />
and first-aid gear. The units cost<br />
lots of money and are mostly left to<br />
fend for themselves out somewhere<br />
in the boondocks.<br />
Thanks to battery-powered sensors<br />
and wireless connectivity, Foresolutions<br />
helps railroads and construction<br />
companies keep track of their<br />
units, tell whether they are being<br />
used and when to call in maintenance.<br />
In addition, the company<br />
has deployed several thousand IoT<br />
devices at Heathrow Airport to keep<br />
track of various non-motorised assets<br />
– tools, steps, tugs and other<br />
equipment – in order to help management<br />
understand their utilisation<br />
and to locate equipment when<br />
needed.<br />
Throughout the past year, Foresolutions<br />
has been partnering with Australia’s<br />
Digital Matter, which makes<br />
battery-powered sensors that leverage<br />
wireless networks – including<br />
LTE, GSM, WiFi and Bluetooth – to<br />
forward data to the cloud, no matter<br />
where the sensor is deployed.<br />
On the mobile toilets, the company<br />
is using Digital Matter's Oyster 2 sensor<br />
devices, powered by three AA<br />
batteries, to update companies with<br />
the information they need to manage<br />
the units.<br />
Traditionally, this type of data cannot<br />
be accessed without a human<br />
visiting the station. Foresolutions'<br />
system can detect not only the GPS<br />
location but also such conditions as<br />
the opening and closing of doors,<br />
vibration, temperature and humidity<br />
changes, as well as water, ice<br />
and other outdoor conditions. Any<br />
changes in location or sensor readings,<br />
such as tilting or moving, are<br />
forwarded to the headquarters so<br />
those in charge of the stations can<br />
tell if they are being moved. After all,<br />
these units cost a lot of money and<br />
theft is not unknown.<br />
IoT data also helps to ensure that the<br />
units are sanitised and well-maintained,<br />
says Tom Ross, Foresolutions'<br />
managing director. He has plans to<br />
expand his solutions beyond mobile<br />
loos, as they’re called in the UK, to<br />
include such markets as farms, factories,<br />
hospitals and shopping centres<br />
or even amusement parks.<br />
source ©: Foresolutions<br />
source ©: Foresolutions<br />
IoT Everywhere<br />
IoT solutions in facility management can<br />
fullfil multipile roles at once, for instance<br />
building & structure monitoring, temperature,<br />
air quality, presence, occupancy,<br />
energy, noise, door opening, weather and<br />
environmental conditions, people tracking,<br />
safe distancing, as well as security & access<br />
control and CCTV.<br />
94
source ©: Marine Science Institute, UC Santa Barbara, Salesforce.com, San Diego State University<br />
SharkEye<br />
AI Drones Track and<br />
Protect Great White Sharks<br />
Academics from the University of<br />
California and San Diego State have<br />
teamed up with AI researchers from<br />
Salesforce to create software that<br />
can spot sharks swimming around<br />
popular beach sites.<br />
SharkEye, as the system is called,<br />
uses drones to spot sharks from<br />
above. The unmanned flying vehicles<br />
follow pre-programmed paths<br />
at a height of around 120 feet (36.5<br />
metres) to cover large areas of the<br />
ocean without disturbing marine<br />
life. The goal of SharkEye is eventually<br />
to produce automated ‘shark reports’<br />
for beachgoers to help them<br />
assess levels of risk.<br />
The researchers hope this application<br />
of AI can help keep beaches<br />
safer, encourage a more informed<br />
public and help people learn how<br />
to share the waves with wildlife. Perhaps,<br />
most importantly, the system<br />
could help protect the gradually improving<br />
populations of great white<br />
sharks, top predators that are a<br />
healthy part of the California ocean<br />
ecosystem, says Doug McCauley, director<br />
of the Benioff Ocean Initiative<br />
and a professor at the University of<br />
California Santa Barbara.<br />
Salesforce AI is using its proprietary<br />
Einstein Vision algorithm – ordinarily<br />
used for visual search, brand<br />
detection and product identification<br />
– to process drone video and<br />
recognise the unique attributes<br />
of sharks, thereby identifying<br />
them without the need for physical<br />
tagging. This information will<br />
then be shared with local officials<br />
and beachside communities, so,<br />
without ever touching the water,<br />
SharkEye can make sure it’s safe for<br />
the rest of us to hop in!<br />
Shark Alarm!<br />
The dashboard created<br />
for the SharkEye project<br />
at Santa Barbara's Parado<br />
Beach is meant to openly<br />
share data insights on<br />
sharks collected from dronebased<br />
arial surveys as well<br />
as acoustic detections. Both<br />
are shown on a current-day<br />
and a seven-day rolling<br />
average.The latter provide<br />
a clearer picture of trends<br />
in abundance compared<br />
to expected variation in<br />
daily peaks and dips in shark<br />
activity. Absence of shark<br />
sightings or acoustic signals<br />
are not an indicator that<br />
no sharks are present - in<br />
California's costal waters,<br />
they almost always are.<br />
The goal here<br />
is to reduce<br />
the number<br />
of traffic<br />
accidents.<br />
Ivan Ndip<br />
Fraunhofer Institute<br />
for Reliability<br />
and Microintegration<br />
(IZM) in Berlin<br />
Fraunhofer<br />
Many Still Wait for 5G –<br />
but 6G is Just<br />
Around the Corner<br />
Most smartphone owners are still<br />
waiting for 5G to appear but the telco<br />
industry is already gearing up for the<br />
next step. The starting pistol for this<br />
next generation of mobile communications,<br />
6G, has already been fired.<br />
"With 6G, we have the ambitious<br />
goal of achieving data rates of terabits<br />
per second and a latency of<br />
about 100 microseconds – that’s 50<br />
times the data rate and one-tenth<br />
the latency of 5G," says Ivan Ndip,<br />
an expert on antennas and radio frequency<br />
systems at the Fraunhofer<br />
Institute for Reliability and Microintegration<br />
(IZM) in Berlin.<br />
Ndip uses autonomous driving to<br />
explain the difference. The goal here,<br />
he says, is to reduce the number of<br />
accidents. 5G has a maximum data<br />
rate of about 20 gigabits per second<br />
– nowhere near enough to communicate<br />
a car’s position to other road<br />
users in real time, much less to measure<br />
distances and scan through 360<br />
degrees at the same time.<br />
The self-driving car needs to be<br />
able to look far into the distance<br />
while also focusing on close-up<br />
things. For this, autonomous vehicles<br />
require sensors that combine<br />
both radar and cameras, and need<br />
to be able to collect enormous<br />
amounts of data and share them<br />
simultaneously. According to Ndip,<br />
Fraunhofer IZM is currently developing<br />
such sensors.<br />
source ©: Fraunhofer Institute for Reliability and Microintegration IZM<br />
95
<strong>Smart</strong> Lifestyle One More Thing<br />
source ©: Khachi<br />
The car must also react instantly to<br />
unforeseen circumstances, so, in addition<br />
to very high data rates, the<br />
sensors must exhibit extremely low<br />
latency. Ndip says, 5G just doesn’t<br />
cut it. He adds that 5G is still missing<br />
a couple of critical components<br />
as well as the network intelligence<br />
necessary to handle true hands-off<br />
autonomous driving.<br />
“That's why we need 6G," the scientist<br />
maintains. Although 6G will not<br />
be operational until at least 2030,<br />
Ndip believes that governments<br />
and telcos need to start investing in<br />
the new technology now.<br />
Hardware still needs to be developed<br />
for mobile communications<br />
above 100 GHz but, for most manufacturers,<br />
this is terra incognita as<br />
they have never worked with frequencies<br />
like these before. Typically,<br />
researchers and developers need a<br />
ten-year head start for this kind of<br />
mammoth project, Ndip says. Setting<br />
the necessary specifications<br />
and standards alone will take at<br />
least five years, he believes.<br />
Fraunhofer recently opened its 6G<br />
Innovation Campus in Cottbus – the<br />
so-called iCampus – where it plans<br />
to do research into new networking<br />
and sensor technologies, together<br />
with the local university and two separate<br />
Leibnitz Institutes. The future of<br />
mobile communications, it seems,<br />
just can’t happen fast enough.<br />
<strong>Smart</strong> Dessous<br />
Myant's new Skiin brand<br />
textiles monitor their<br />
owner's vital functions<br />
and sleeping habits<br />
and can even wake up<br />
sleepy drivers before<br />
they doze off at the<br />
wheel.<br />
Myant<br />
A New ‘Brief’<br />
in Health Monitoring<br />
Underwear is getting a lot smarter<br />
these days. Myant, an innovator in<br />
wearables, has developed a smart<br />
pair of briefs that could potentially<br />
transform healthcare.<br />
Biometric sensors woven into the<br />
fabric of the underwear can measure<br />
things like sleep quality, activity,<br />
stress levels, temperature and<br />
heart condition, to provide some of<br />
the most reliable and effective ways<br />
to detect and prevent health issues,<br />
the company claims.<br />
The Skiin brand fabric sends data<br />
to a corresponding app and onwards<br />
to the cloud platform which<br />
analyses the data to provide guidance<br />
on lifestyle changes and the<br />
information can, with permission,<br />
be shared with healthcare providers.<br />
Underwear is a good choice for<br />
a smart garment because it makes<br />
consistent, close contact with the<br />
body – a must-have for continuous<br />
skin sensors.<br />
Myant’s underwear innovation fits<br />
into the larger trend of e-textiles<br />
and smart clothing, powered by<br />
artificial intelligence and tiny semiconductor<br />
technology. Scientists<br />
are attempting to replace clunky<br />
ECGs and health monitoring devices,<br />
like watches and chest straps,<br />
with comfortable smart garments.<br />
Healthcare providers and developers<br />
believe advances like these will<br />
increase compliance and lead to<br />
better health outcomes.<br />
<strong>Smart</strong> garments will probably be<br />
able to do much more for us. Sensors<br />
can now be embedded directly<br />
into textiles – similar to weaving additional<br />
yarn into an existing piece<br />
of fabric – or by applying sensors<br />
to the top of the fabric. Either way,<br />
the use cases for e-textiles go far beyond<br />
health monitoring. <strong>Smart</strong> garments<br />
can to do things like:<br />
• diagnose comfort levels of amputees<br />
by monitoring their interaction<br />
with their artificial limb.<br />
• assess patterns in athletes’ performances<br />
and deliver small electric<br />
shocks to underperforming<br />
muscles.<br />
• wake up sleepy drivers on the<br />
road before accidents occur, using<br />
built-in fatigue monitoring.<br />
• connect to smart home systems<br />
to do things like changing the<br />
thermostat when your body is<br />
cold (or hot).<br />
The latest report by research firm<br />
IDTechE predicts that smart textiles<br />
will be worth over $1.4 billion by<br />
2030. The number of potential applications<br />
and markets for e-textiles<br />
is vast, including military and space,<br />
automotive, haptic suits for virtual<br />
reality, sports and fitness, and assistive<br />
clothing.<br />
source ©: Skiin<br />
96
Kerlink<br />
Windmills Push Spread of<br />
Public IoT Services<br />
Like many others along the Netherlands<br />
North Sea coast, the Port of<br />
Moerdijk has a large wind farm. The<br />
farm was installed in 2020 and is<br />
operated by Vattenfall, a European<br />
green energy specialist. The wind<br />
farm supplies 27 megawatts of<br />
clean energy to more than 27,000<br />
households.<br />
But officials soon realised the turbine<br />
towers could serve an additional<br />
purpose by hosting an IoT<br />
network to provide key sensor data<br />
to the bustling port 120 metres below.<br />
IoT networking company Kerlink<br />
was commissioned to create the<br />
gateways for the LoRaWAN project.<br />
The Kerlink Wirnet iStation receives<br />
sensor data and information from<br />
within a radius of 25 kilometres and<br />
securely transfers it to users of the<br />
energy-efficient IoT network. This<br />
includes monitoring air quality,<br />
CO2 emissions, water levels and detecting<br />
whether bridges and gates<br />
around the port are open or closed,<br />
source ©: Kerlink<br />
which helps move traffic more efficiently<br />
while reducing emissions.<br />
In addition, the industrial-grade<br />
IoT network will be available at low<br />
cost for organisations near the port<br />
in shipping, rail and other industries<br />
as well as to municipalities,<br />
government agencies and individuals.<br />
Aurélien Seugnet, Kerlink’s business<br />
developer, is happy with the<br />
results so far. “The wind industry<br />
The wind<br />
industry could<br />
be crucial to<br />
builidng the<br />
public Internet<br />
of Things.<br />
<strong>Smart</strong> Station<br />
The Kerlink Wirnet<br />
iStation receives<br />
sensor data and<br />
information from<br />
within a radius of<br />
25 km and can<br />
monitor air quality<br />
in addition.<br />
Aurélien Seugnet<br />
Kerlink<br />
could become a crucial building<br />
block in the public Internet of<br />
Things,” he believes. “We usually<br />
use high buildings and pylons [as<br />
mounting points],” he added – so<br />
why not use turbine towers?<br />
The height of the towers means<br />
the signal is stronger and can reach<br />
further. Besides which, piggybacking<br />
on a wind generator does away<br />
with the constant need to change<br />
batteries.<br />
source ©: CCM Benchmark Group<br />
source ©: Storm<br />
97
Column Gerd Leonhard<br />
The Future<br />
Looks Great!<br />
Are you excited about the future or are<br />
you worried? Are you expecting good<br />
things or more misery? These days, it seems<br />
like all around us, the future is getting bleaker<br />
and bleaker. Netflix and Hollywood are telling us about<br />
dystopian scenarios. The news is showing more reels<br />
of climate change disasters, economic issues, clueless<br />
CEOs and politicians. And of course, in the end, the robots<br />
will take our jobs, and then they're going to harvest<br />
our bodies for energy.<br />
But despite all of that noise, I am here to tell you that the<br />
future is better than we think. I believe that human ingenuity,<br />
our science and technology can and will solve<br />
most of our long-standing problems. I also believe that<br />
human kindness and the ability to collaborate will prevail.<br />
But we're running out of time because the future is<br />
arriving faster than we think. Actually, the future is already<br />
here, we just haven't paid enough attention.<br />
Whether it’s enhancing humans, designing chimeras or<br />
robots going to war: What will happen during the next<br />
ten years will sweep away most of our notions about<br />
gradual progress and upend our views about how technological<br />
innovation usually and maybe even inadvertently<br />
furthers the common good.<br />
In my speeches, I have recently started talking about<br />
what I call “the good future” – a utopia (or better yet,<br />
a protopia) as opposed to a dystopia. As hard as it may<br />
be for all of us to agree on what a “good” future would<br />
look like, we must submit to the hard work of creating<br />
such a definition. Because, if we don’t reach some kind<br />
of consensus, there may be no future at all – at least not<br />
for us humans. One thing we know for certain is that<br />
the Good Future is not likely to come about with good<br />
Gerd Leonhard<br />
is the founder of<br />
The Futures Agency (TFA)<br />
and author<br />
of the bestseller<br />
Technology vs Humanity.<br />
He is based in Zurich<br />
Technology is<br />
morally neutral<br />
until we use it.<br />
William Gibson<br />
old-fashioned “greed capitalism”, and neither<br />
will it be ushered in by technology. Rather, it will<br />
be a question of ethics and values – and the policies<br />
we craft from them.<br />
Now is the time to think about and act on “civilising”<br />
– maybe a better word would be “rehumanising” our<br />
technology. Yes, this will mean regulating (but not<br />
strangulating) the global tech giants, because in this<br />
age of advanced exponential change, today’s amazing<br />
breakthroughs may well turn out to be major problems<br />
not too far down the road.<br />
It’s time to stop asking “what will the future bring” – it<br />
can, quite literally, bring almost anything we can imagine.<br />
Instead, we need to ask: “what kind of future do we<br />
want?<br />
It is a basic truth that technology can serve opposite<br />
purposes, good or bad. And as William Gibson famously<br />
said, it remains morally neutral until we use it.<br />
“Too much of a good thing” describes this conundrum<br />
very well: something quite useful can quickly become<br />
something deeply harmful and corrosive to society –<br />
as recently evidenced with social media, which suffers<br />
from excessive monetisation obsession and utter lack<br />
of accountability.<br />
We are at a fork in the road: The future is our choice,<br />
by action or by inaction. And time is of the essence. We<br />
have at most ten short years to debate, agree on and<br />
implement new, global (or at least territorial) frameworks<br />
and rules as far as governing exponential technologies<br />
are concerned.<br />
Call me an optimist or a utopian, but I am convinced<br />
that we can still define and shape a “good future” for all<br />
of mankind – as well as for our planet.<br />
98
We Talk IoT,<br />
the <strong>Smart</strong> <strong>Industry</strong> Podcast<br />
Welcome to We talk IoT, a regular series of podcasts<br />
from the editors of <strong>Smart</strong> <strong>Industry</strong> – the IoT<br />
Business Magazine. Our podcast keeps you up to<br />
date on the most important developments in the<br />
world of IoT, IIoT, Artificial Intelligence and Cognitive<br />
Computing. Listen to leading industry experts,<br />
business professionals and experienced journalists<br />
as they discuss some of today’s hottest tech topics<br />
and how they can help boost your bottom line.<br />
You can listen to the first episode right here on<br />
smart-industry.net. Or you can follow We talk<br />
IoT, the <strong>Smart</strong> <strong>Industry</strong> podcast on the following<br />
streaming providers to always get the latest<br />
episodes:<br />
Go to Spotify<br />
Go to Apple Music<br />
Go to Soundcloud<br />
This podcast is brought to you by Avnet Silica in<br />
cooperation with Microsoft.<br />
powered by
Let our wide portfolio help<br />
you meet your analog needs<br />
Innovative products for reliable,<br />
accurate, high-efficiency designs<br />
Operational Amplifiers<br />
• High voltage<br />
• Precision and high accuracy<br />
• Dual high bandwidth<br />
Power Operational Amplifiers<br />
• High output current<br />
• Low drop and high gain<br />
Current sense amplifiers<br />
• Uni- and bi-directional<br />
• Integrated, robust, and safe<br />
For more information visit www.st.com/opamp