19.02.2019 Views

ST1901

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

CASE STUDY: CASE STUDY: EURONEXT<br />

"We can set up an environment for a data scientist in less than one day, compared to<br />

the 40 days it used to take, and we have moved from D+1 analytics to real-time<br />

analytics. This is fundamental to understanding markets, clients, competitors, and how<br />

they interact."<br />

that cause high volumes on the markets."<br />

Still, the transition to a Platform as a Service<br />

(PaaS) does require one key condition:<br />

remaining independent of the cloud provider.<br />

"The core of the data lake is managed by<br />

Talend. It was very important for us to keep<br />

this 'independence' compared to the layers<br />

below Talend. So, if tomorrow Euronext wants<br />

to change clouds, they can," says the CDO,<br />

happy about the greater flexibility. Euronext<br />

chose Talend Big Data to absorb real-time<br />

data in the data lake, including internal data<br />

from its own trading platform; and external<br />

data, such as from Reuters and Bloomberg.<br />

In an ultra-regulated world, Talend has also<br />

proven to be highly adept at meeting the<br />

challenges of data lake governance and<br />

regulatory compliance. Being able to safely<br />

open data involves knowing it inside out,<br />

keeping track of changes and the history of<br />

data feeds, and knowing how to classify them<br />

in a granular structure.<br />

This governance strategy is applied in very<br />

specific tools, such as the Talend Data<br />

Catalog. A dictionary is created together with<br />

each technical project for each individual<br />

market. These dictionaries are used to find the<br />

history of end-to-end data, from the sources<br />

to the reporting.<br />

"Now I can see when S3 is the data source, I<br />

can add value to the data, combine it with<br />

other data, and convert it into other data in<br />

Redshift," says Belarfaoui, who is very satisfied<br />

with the new process. "I can also add tags.<br />

Typically, we add the storage duration. For<br />

example, whether data has to be kept for ten<br />

years, or five years (per MIFID II), or if it<br />

should be archived."<br />

At the same time, data lineage with Talend<br />

drastically reduces impact analysis costs. "One<br />

simple example comes to mind: we plan to<br />

change the value of an index on the British<br />

stock market. Once we integrate it into our<br />

systems, it propagates itself pretty much<br />

everywhere. Currently we have to figure 200<br />

person-days just to find the index in our<br />

different systems. But with the dictionary, we are<br />

able to run this data lineage with just one click."<br />

MONETIZING STOCK MARKET DATA<br />

Two years after its launch, the governed lake<br />

project with Talend and AWS is a success.<br />

"The initial returns are more than positive,"<br />

says Belarfaoui. "On the technical side, we<br />

can manage ten times more iso-budget data."<br />

Beyond the improved architecture, the<br />

migration is also positioning Euronext to<br />

become a "data trader." The stock market<br />

operator wanted to be able to refine and add<br />

to its wealth of data in order to monetize it. In<br />

fact, the sale of data already brings in 20% of<br />

Euronext's revenues.<br />

"Traders actually sell, buy, and make their<br />

investment decisions in milliseconds. They<br />

have a huge appetite for aggregated data in<br />

real time. Who sells which stock, to whom, at<br />

what price and when. We are in the best<br />

position to track performance of the CAC 40<br />

or other indexes and sell that information to<br />

investors through our Datashop platform,"<br />

says Belarfaoui.<br />

In addition to clients, this project also<br />

involves giving data scientists and business<br />

units self-service access to this data, which<br />

they can analyse in data sandboxes for tasks<br />

such as market monitoring. Belarfaoui<br />

explains: "We can set up an environment for a<br />

data scientist in less than one day, compared<br />

to the 40 days it used to take, and we have<br />

moved from D+1 analytics to real-time<br />

analytics. This is fundamental to<br />

understanding markets, clients, competitors,<br />

and how they interact."<br />

This is a real turning point for Euronext. "In<br />

2016, we identified the need, but we didn't<br />

have the capacity to do it. At the time, we<br />

could only relay the volumes of market activity<br />

to market regulators (Mifid II). Today, we can<br />

dig deeper. Under the General Data Protection<br />

Regulation (GDPR), I have to know where<br />

personal data is stored. If I receive requests for<br />

modification or deletion, I can find the data,<br />

thanks to the dictionary," elaborates Belarfaoui.<br />

"Similarly, a user who searches a transaction<br />

can instantly see if it is confidential. Once data<br />

is identified as being critical, the data steward<br />

can deny user access."<br />

Euronext is just at the beginning of its digital<br />

transformation. A study is currently underway<br />

on the deployment of Talend's Master Data<br />

Management (MDM) solution. "We are<br />

working on 'golden sources' within all of our<br />

systems (CRM, trading, billing, finance,<br />

various departments, subsidiaries, etc.). The<br />

goal is to make all Euronext data even cleaner<br />

and of higher quality, such as by being sure<br />

that a client is consistently represented across<br />

all systems. Such standards will make our<br />

data even more usable," predicts Belarfaoui.<br />

More info: www.talend.com<br />

www.storagemagazine.co.uk<br />

@STMagAndAwards<br />

Jan/Feb 2019<br />

STORAGE<br />

MAGAZINE<br />

19

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!