Implementing Software Resiliency in HPX for Extreme Scale Computing

by   Nikunj Gupta, et al.

Exceptions and errors occurring within mission critical applications due to hardware failures have a high cost. With the emerging Next Generation Platforms (NGPs), the rate of hardware failures will invariably increase. Therefore, designing our applications to be resilient is a critical concern in order to retain the reliability of results while meeting the constraints on power budgets. In this paper, we implement software resilience in HPX, an Asynchronous Many-Task Runtime system. We implement two resiliency APIs that we expose to the application developers, namely task replication and task replay. Task replication repeats a task n-times and executes them asynchronously. Task replay will reschedule a task up to n-times until a valid output is returned. Furthermore, we introduce an API that allows the application to verify the returned result with a user provided predicate. We test the APIs with both artificial workloads and a dataflow based stencil application. We demonstrate that only minor overheads are incurred when utilizing these resiliency features for work loads where the task size is greater than 200 μs. We also show that most of the added execution time arises from the replay or replication of the tasks themselves and not by the implementation of the APIs.


page 1

page 2

page 3

page 4


Towards Distributed Software Resilience in Asynchronous Many-Task Programming Models

Exceptions and errors occurring within mission critical applications due...

HyCoR: Fault-Tolerant Replicated Containers Based on Checkpoint and Replay

HyCoR is a fully-operational fault tolerance mechanism for multiprocesso...

Engineering Record And Replay For Deployability: Extended Technical Report

The ability to record and replay program executions with low overhead en...

Enabling Software Resilience in GPGPU Applications via Partial Thread Protection

Graphics Processing Units (GPUs) are widely used by various applications...

TeaMPI – Replication-based Resilience without the (Performance) Pain

In an era where we can not afford to checkpoint frequently, replication ...

Resiliency in Numerical Algorithm Design for Extreme Scale Simulations

This work is based on the seminar titled “Resiliency in Numerical Algori...

CHEX: Multiversion Replay with Ordered Checkpoints

In scientific computing and data science disciplines, it is often necess...

Please sign up or login with your details

Forgot password? Click here to reset