ST1901
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
CASE STUDY: CASE STUDY: EURONEXT<br />
"We can set up an environment for a data scientist in less than one day, compared to<br />
the 40 days it used to take, and we have moved from D+1 analytics to real-time<br />
analytics. This is fundamental to understanding markets, clients, competitors, and how<br />
they interact."<br />
that cause high volumes on the markets."<br />
Still, the transition to a Platform as a Service<br />
(PaaS) does require one key condition:<br />
remaining independent of the cloud provider.<br />
"The core of the data lake is managed by<br />
Talend. It was very important for us to keep<br />
this 'independence' compared to the layers<br />
below Talend. So, if tomorrow Euronext wants<br />
to change clouds, they can," says the CDO,<br />
happy about the greater flexibility. Euronext<br />
chose Talend Big Data to absorb real-time<br />
data in the data lake, including internal data<br />
from its own trading platform; and external<br />
data, such as from Reuters and Bloomberg.<br />
In an ultra-regulated world, Talend has also<br />
proven to be highly adept at meeting the<br />
challenges of data lake governance and<br />
regulatory compliance. Being able to safely<br />
open data involves knowing it inside out,<br />
keeping track of changes and the history of<br />
data feeds, and knowing how to classify them<br />
in a granular structure.<br />
This governance strategy is applied in very<br />
specific tools, such as the Talend Data<br />
Catalog. A dictionary is created together with<br />
each technical project for each individual<br />
market. These dictionaries are used to find the<br />
history of end-to-end data, from the sources<br />
to the reporting.<br />
"Now I can see when S3 is the data source, I<br />
can add value to the data, combine it with<br />
other data, and convert it into other data in<br />
Redshift," says Belarfaoui, who is very satisfied<br />
with the new process. "I can also add tags.<br />
Typically, we add the storage duration. For<br />
example, whether data has to be kept for ten<br />
years, or five years (per MIFID II), or if it<br />
should be archived."<br />
At the same time, data lineage with Talend<br />
drastically reduces impact analysis costs. "One<br />
simple example comes to mind: we plan to<br />
change the value of an index on the British<br />
stock market. Once we integrate it into our<br />
systems, it propagates itself pretty much<br />
everywhere. Currently we have to figure 200<br />
person-days just to find the index in our<br />
different systems. But with the dictionary, we are<br />
able to run this data lineage with just one click."<br />
MONETIZING STOCK MARKET DATA<br />
Two years after its launch, the governed lake<br />
project with Talend and AWS is a success.<br />
"The initial returns are more than positive,"<br />
says Belarfaoui. "On the technical side, we<br />
can manage ten times more iso-budget data."<br />
Beyond the improved architecture, the<br />
migration is also positioning Euronext to<br />
become a "data trader." The stock market<br />
operator wanted to be able to refine and add<br />
to its wealth of data in order to monetize it. In<br />
fact, the sale of data already brings in 20% of<br />
Euronext's revenues.<br />
"Traders actually sell, buy, and make their<br />
investment decisions in milliseconds. They<br />
have a huge appetite for aggregated data in<br />
real time. Who sells which stock, to whom, at<br />
what price and when. We are in the best<br />
position to track performance of the CAC 40<br />
or other indexes and sell that information to<br />
investors through our Datashop platform,"<br />
says Belarfaoui.<br />
In addition to clients, this project also<br />
involves giving data scientists and business<br />
units self-service access to this data, which<br />
they can analyse in data sandboxes for tasks<br />
such as market monitoring. Belarfaoui<br />
explains: "We can set up an environment for a<br />
data scientist in less than one day, compared<br />
to the 40 days it used to take, and we have<br />
moved from D+1 analytics to real-time<br />
analytics. This is fundamental to<br />
understanding markets, clients, competitors,<br />
and how they interact."<br />
This is a real turning point for Euronext. "In<br />
2016, we identified the need, but we didn't<br />
have the capacity to do it. At the time, we<br />
could only relay the volumes of market activity<br />
to market regulators (Mifid II). Today, we can<br />
dig deeper. Under the General Data Protection<br />
Regulation (GDPR), I have to know where<br />
personal data is stored. If I receive requests for<br />
modification or deletion, I can find the data,<br />
thanks to the dictionary," elaborates Belarfaoui.<br />
"Similarly, a user who searches a transaction<br />
can instantly see if it is confidential. Once data<br />
is identified as being critical, the data steward<br />
can deny user access."<br />
Euronext is just at the beginning of its digital<br />
transformation. A study is currently underway<br />
on the deployment of Talend's Master Data<br />
Management (MDM) solution. "We are<br />
working on 'golden sources' within all of our<br />
systems (CRM, trading, billing, finance,<br />
various departments, subsidiaries, etc.). The<br />
goal is to make all Euronext data even cleaner<br />
and of higher quality, such as by being sure<br />
that a client is consistently represented across<br />
all systems. Such standards will make our<br />
data even more usable," predicts Belarfaoui.<br />
More info: www.talend.com<br />
www.storagemagazine.co.uk<br />
@STMagAndAwards<br />
Jan/Feb 2019<br />
STORAGE<br />
MAGAZINE<br />
19