A Realtime Monitoring Platform for Workflow Subroutines

03/06/2022
by   Dulani Meedeniya, et al.
0

With the advancement in distributed computing, workflow management systems have shifted towards executing processes on top of distributed and parallel information systems, resulting in distributed workflow management systems. Furthermore, in the present reuse-oriented software engineering era, developers tend to use existing software components or cloud services to build applications rather than developing as all new code. One such requirement in distributed workflow management systems is the monitoring of the progress and state of each of the tasks from a central location. End users should be able to track information of a workflow such as real-time status, anomalies and failures. However, it is challenging to find such platforms or services to remotely observe the progress or the state of a distributed workflow execution. Developers are required to build such monitoring modules from the ground up. In this paper, we attempt to design a cloud service which can provide real-time monitoring for distributed workflow executions. The proposed solution provides a pluggable service module enabling remote monitoring of workflow execution, observation of current state and debugging of the service from a central location. The solution is presented as a simple API, where the developer is only required to invoke methods and publish the state, followed by the reception of such broadcasts from a remote user interface for monitoring. Experiment results suggest the system demonstrates effective real-time monitoring capabilities with improved performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2020

Workflow-as-a-Service Cloud Platform and Deployment of Bioinformatics Workflow Applications

Workflow management systems (WMS) support the composition and deployment...
research
01/10/2021

An Empirical Study on Serverless Workflow Service

Along with the wide-adoption of Serverless Computing, more and more appl...
research
03/15/2022

Data Transfer and Network Services management for Domain Science Workflows

This paper describes a vision and work in progress to elevate network re...
research
01/11/2018

The archive solution for distributed workflow management agents of the CMS experiment at LHC

The CMS experiment at the CERN LHC developed the Workflow Management Arc...
research
11/23/2022

Towards Advanced Monitoring for Scientific Workflows

Scientific workflows consist of thousands of highly parallelized tasks e...
research
07/11/2023

SecFlow: Adaptive Security-Aware Workflow Management System in Multi-Cloud Environments

In this paper, we propose an architecture for a security-aware workflow ...
research
04/14/2022

A Case for Microservices Orchestration Using Workflow Engines

Microservices have become the de-facto software architecture for cloud-n...

Please sign up or login with your details

Forgot password? Click here to reset