Poster: A Real-World Distributed Infrastructure for Processing Financial Data at Scale

10/29/2020
by   Sebastian Frischbier, et al.
0

Financial markets are event- and data-driven to an extremely high degree. For making decisions and triggering actions stakeholders require notifications about significant events and reliable background information that meet their individual requirements in terms of timeliness, accuracy, and completeness. As one of Europe's leading providers of financial data and regulatory solutions vwd processes an average of 18 billion event notifications from 500+ data sources for 30 million symbols per day. Our large-scale distributed event-based systems handle daily peak rates of 1+ million event notifications per second and additional load generated by singular pivotal events with global impact. In this poster we give practical insights into our IT systems. We outline the infrastructure we operate and the event-driven architecture we apply at vwd. In particular we showcase the (geo)distributed publish/subscribe broker network we operate across locations and countries to provide market data to our customers with varying quality of information (QoI) properties.

READ FULL TEXT

page 1

page 2

research
08/08/2019

Managing the Complexity of Processing Financial Data at Scale – an Experience Report

Financial markets are extremely data-driven and regulated. Participants ...
research
10/29/2020

Poster: Benchmarking Financial Data Feed Systems

Data-driven solutions for the investment industry require event-based ba...
research
03/03/2020

Investigating the influence Brexit had on Financial Markets, in particular the GBP/EUR exchange rate

On 23rd June 2016, 51.9 triggering a process and events that have led to...
research
07/18/2019

ELG: An Event Logic Graph

The evolution and development of events have their own basic principles,...
research
12/14/2020

Event Data Quality: A Survey

Event data are prevalent in diverse domains such as financial trading, b...
research
05/30/2014

ELM Solutions for Event-Based Systems

Whilst most engineered systems use signals that are continuous in time, ...
research
07/03/2019

Key Event Receipt Infrastructure (KERI)

A decentralized key management infrastructure (DKMI) that uses the desig...

Please sign up or login with your details

Forgot password? Click here to reset