The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

10/04/2020
by   Gordon Gibb, et al.
0

The use of High Performance Computing (HPC) to compliment urgent decision making in the event of disasters is an important future potential use of supercomputers. However, the usage modes involved are rather different from how HPC has been used traditionally. As such, there are many obstacles that need to be overcome, not least the unbounded wait times in the batch system queues, to make the use of HPC in disaster response practical. In this paper, we present how the VESTEC project plans to overcome these issues and develop a working prototype of an urgent computing control system. We describe the requirements for such a system and analyse the different technologies available that can be leveraged to successfully build such a system. We finally explore the design of the VESTEC system and discuss ongoing challenges that need to be addressed to realise a production level system.

READ FULL TEXT
research
10/17/2020

The role of interactive super-computing in using HPC for urgent decision making

Technological advances are creating exciting new opportunities that have...
research
08/08/2023

NSF RESUME HPC Workshop: High-Performance Computing and Large-Scale Data Management in Service of Epidemiological Modeling

The NSF-funded Robust Epidemic Surveillance and Modeling (RESUME) projec...
research
02/22/2021

BayesPerf: Minimizing Performance Monitoring Errors Using Bayesian Statistics

Hardware performance counters (HPCs) that measure low-level architectura...
research
03/26/2021

Secure Platform for Processing Sensitive Data on Shared HPC Systems

High performance computing clusters operating in shared and batch mode p...
research
12/05/2016

BrainFrame: A node-level heterogeneous accelerator platform for neuron simulations

Objective: The advent of High-Performance Computing (HPC) in recent year...
research
09/02/2021

Habitual and Reflective Control in Hierarchical Predictive Coding

In cognitive science, behaviour is often separated into two types. Refle...

Please sign up or login with your details

Forgot password? Click here to reset