Using Meta-heuristics and Machine Learning for Software Optimization of Parallel Computing Systems: A Systematic Literature Review

by   Suejb Memeti, et al.

While the modern parallel computing systems offer high performance, utilizing these powerful computing resources to the highest possible extent demands advanced knowledge of various hardware architectures and parallel programming models. Furthermore, optimized software execution on parallel computing systems demands consideration of many parameters at compile-time and run-time. Determining the optimal set of parameters in a given execution context is a complex task, and therefore to address this issue researchers have proposed different approaches that use heuristic search or machine learning. In this paper, we undertake a systematic literature review to aggregate, analyze and classify the existing software optimization methods for parallel computing systems. We review approaches that use machine learning or meta-heuristics for software optimization at compile-time and run-time. Additionally, we discuss challenges and future research directions. The results of this study may help to better understand the state-of-the-art techniques that use machine learning and meta-heuristics to deal with the complexity of software optimization for parallel computing systems. Furthermore, it may aid in understanding the limitations of existing approaches and identification of areas for improvement.


page 1

page 2

page 3

page 4


A Literature Review on Serverless Computing

Serverless computing is an emerging cloud computing paradigm. Moreover, ...

Benchmarking Machine Learning: How Fast Can Your Algorithms Go?

This paper is focused on evaluating the effect of some different techniq...

Parallel computational optimization in operations research: A new integrative framework, literature review and research directions

Solving optimization problems with parallel algorithms has a long tradit...

Real-Time Parallel Programming: State of Play and Open Issues

Real-time systems applications usually consist of a set of concurrent ac...

Parallel Statistical Computing with R: An Illustration on Two Architectures

To harness the full benefit of new computing platforms, it is necessary ...

Ensemble-based modeling abstractions for modern self-optimizing systems

In this paper, we extend our ensemble-based component model DEECo with t...

Please sign up or login with your details

Forgot password? Click here to reset