How Tertiary Studies perform Quality Assessment of Secondary Studies in Software Engineering

10/07/2021
by   Dolors Costal, et al.
0

Context: Tertiary studies are becoming increasingly popular in software engineering as an instrument to synthesise evidence on a research topic in a systematic way. In order to understand and contextualize their findings, it is important to assess the quality of the selected secondary studies. Objective: This paper aims to provide a state of the art on the assessment of secondary studies' quality as conducted in tertiary studies in the area of software engineering, reporting the frameworks used as instruments, the facets examined in these frameworks, and the purposes of the quality assessment. Method: We designed this study as a systematic mapping responding to four research questions derived from the objective above. We applied a rigorous search protocol over the Scopus digital library, resulting in 47 papers after application of inclusion and exclusion criteria. The extracted data was synthesised using content analysis. Results: A majority of tertiary studies perform quality assessment. It is not often used for excluding studies, but to support some kind of investigation. The DARE quality assessment framework is the most frequently used, with customizations in some cases to cover missing facets. We outline the first steps towards building a new framework to address the shortcomings identified. Conclusion: This paper is a step forward establishing a foundation for researchers in two different ways. As authors of tertiary studies, understanding the different possibilities in which they can perform quality assessment of secondary studies. As readers, having an instrument to understand the methodological rigor upon which tertiary studies may claim their findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2021

Inclusion and Exclusion Criteria in Software Engineering Tertiary Studies: A Systematic Mapping and Emerging Framework

Context: Tertiary studies in software engineering (TS@SE) are widely use...
research
09/21/2021

A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

Context: Systematic literature reviews (SLRs) have become standard pract...
research
08/29/2022

Immersive Learning Frameworks: A Systematic Literature Review

Contribution: This secondary study examines the literature on immersive ...
research
03/11/2021

Exploring the Mysteries of System-Level Test

System-level test, or SLT, is an increasingly important process step in ...
research
05/23/2021

Data Quality in Empirical Software Engineering: A Targeted Review

Context: The utility of prediction models in empirical software engineer...
research
04/03/2020

A Tertiary and Secondary Study Canvas

Over the past years, more secondary (Systematic Literature Reviews and S...
research
04/25/2022

Sustainability in Software Architecture: A Systematic Mapping Study

Sustainability is an increasingly-studied topic in software engineering ...

Please sign up or login with your details

Forgot password? Click here to reset