Cloud Workload Prediction based on Workflow Execution Time Discrepancies

by   Gabor Kecskemeti, et al.

Infrastructure as a service clouds hide the complexity of maintaining the physical infrastructure with a slight disadvantage: they also hide their internal working details. Should users need knowledge about these details e.g., to increase the reliability or performance of their applications, they would need solutions to detect behavioural changes in the underlying system. Existing runtime solutions for such purposes offer limited capabilities as they are mostly restricted to revealing weekly or yearly behavioural periodicity in the infrastructure. This article proposes a technique for predicting generic background workload by means of simulations that are capable of providing additional knowledge of the underlying private cloud systems in order to support activities like cloud orchestration or workflow enactment. Our technique uses long-running scientific workflows and their behaviour discrepancies and tries to replicate these in a simulated cloud with known (trace-based) workloads. We argue that the better we can mimic the current discrepancies the better we can tell expected workloads in the near future on the real life cloud. We evaluated the proposed prediction approach with a biochemical application on both real and simulated cloud infrastructures. The proposed algorithm has shown to produce significantly ( 20 predictions for the future of simulated clouds than random workload selection.


CWD: A Machine Learning based Approach to Detect Unknown Cloud Workloads

Workloads in modern cloud data centers are becoming increasingly complex...

Scalable Infrastructure for Workload Characterization of Cluster Traces

In the recent past, characterizing workloads has been attempted to gain ...

On the Potential of Execution Traces for Batch Processing Workload Optimization in Public Clouds

With the growing amount of data, data processing workloads and the manag...

LWS: A Framework for Log-based Workload Simulation in Session-based SUT

Microservice-based applications and cloud-native systems have been widel...

Towards Self-Improving Hybrid Elasticity Control of Cloud-based Software Systems

Elasticity is a form of self-adaptivity in cloud-based software systems ...

Implementing a scalable and elastic computing environment based on Cloud Containers

In this article we look at the potential of cloud containers and we prov...

Online Memory Leak Detection in the Cloud-based Infrastructures

A memory leak in an application deployed on the cloud can affect the ava...

Please sign up or login with your details

Forgot password? Click here to reset