Reproducibility Companion Paper: Describing Subjective Experiment Consistency by p-Value P-P Plot

09/01/2022
by   Jakub Nawała, et al.
0

In this paper we reproduce experimental results presented in our earlier work titled "Describing Subjective Experiment Consistency by p-Value P-P Plot" that was presented in the course of the 28th ACM International Conference on Multimedia. The paper aims at verifying the soundness of our prior results and helping others understand our software framework. We present artifacts that help reproduce tables, figures and all the data derived from raw subjective responses that were included in our earlier work. Using the artifacts we show that our results are reproducible. We invite everyone to use our software framework for subjective responses analyses going beyond reproducibility efforts.

READ FULL TEXT

page 1

page 2

page 3

research
05/21/2023

Reproducibility Requires Consolidated Artifacts

Machine learning is facing a 'reproducibility crisis' where a significan...
research
09/28/2020

Describing Subjective Experiment Consistency by p-Value P-P Plot

There are phenomena that cannot be measured without subjective testing. ...
research
05/20/2022

Reproducibility of the First Image of a Black Hole in the Galaxy M87 from the Event Horizon Telescope (EHT) Collaboration

This paper presents an interdisciplinary effort aiming to develop and sh...
research
12/27/2022

Building a Culture of Reproducibility in Academic Research

Reproducibility is an ideal that no researcher would dispute "in the abs...
research
11/15/2021

Reproducible and Adaptable Log Data Generation for Sound Cybersecurity Experiments

Artifacts such as log data and network traffic are fundamental for cyber...

Please sign up or login with your details

Forgot password? Click here to reset