research
∙
08/29/2023
Large Language Models in Fault Localisation
Large Language Models (LLMs) have shown promise in multiple software eng...
share
research
∙
08/25/2023
COCO: Testing Code Generation Systems via Concretized Instructions
Code generation systems have been extensively developed in recent years ...
research
∙
08/05/2023
LLM is Like a Box of Chocolates: the Non-determinism of ChatGPT in Code Generation
There has been a recent explosion of research on Large Language Models (...
research
∙
07/25/2023
An Empirical Study on Fairness Improvement with Multiple Protected Attributes
Existing research mostly improves the fairness of Machine Learning (ML) ...
research
∙
02/05/2023
Simulation-Driven Automated End-to-End Test and Oracle Inference
This is the first work to report on inferential testing at scale in indu...
research
∙
12/22/2022
Keeping Mutation Test Suites Consistent and Relevant with Long-Standing Mutants
Mutation testing has been demonstrated to be one of the most powerful fa...
research
∙
07/20/2022
Fairness Testing: A Comprehensive Survey and Analysis of Trends
Software systems are vulnerable to fairness bugs and frequently exhibit ...
research
∙
07/14/2022
Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey
This paper provides a comprehensive survey of bias mitigation methods fo...
research
∙
07/07/2022
A Comprehensive Empirical Study of Bias Mitigation Methods for Software Fairness
Software bias is an increasingly important operational concern for softw...
research
∙
10/13/2021
Leveraging Automated Unit Tests for Unsupervised Code Translation
With little to no parallel data available for programming languages, uns...
research
∙
11/21/2020
An Empirical Study on Failed Error Propagation in Java Programs with Real Faults
During testing, developers can place oracles externally or internally wi...
research
∙
08/08/2020
FrUITeR: A Framework for Evaluating UI Test Reuse
UI testing is tedious and time-consuming due to the manual effort requir...
research
∙
04/15/2020
Ownership at Large – Open Problems and Challenges in Ownership Management
Software-intensive organizations rely on large numbers of software asset...
research
∙
04/11/2020
WES: Agent-based User Interaction Simulation on Real Infrastructure
We introduce the Web-Enabled Simulation (WES) research agenda, and descr...
research
∙
12/06/2019
FlakiMe: Laboratory-Controlled Test Flakiness Impact Assessment. A Case Study on Mutation Testing and Program Repair
Much research on software testing makes an implicit assumption that test...
research
∙
10/07/2019
Automatic Testing and Improvement of Machine Translation
This paper presents TransRepair, a fully automatic approach for testing ...
research
∙
08/07/2019
A Survey of Constrained Combinatorial Testing
Combinatorial Testing (CT) is a potentially powerful testing technique, ...
research
∙
06/19/2019
Machine Learning Testing: Survey, Landscapes and Horizons
This paper provides a comprehensive survey of Machine Learning Testing (...
research
∙
05/29/2019
Sub-Turing Islands in the Wild
Recently, there has been growing debate as to whether or not static anal...
research
∙
05/24/2019
Perturbed Model Validation: A New Framework to Validate Model Relevance
This paper introduces PMV (Perturbed Model Validation), a new technique ...
research
∙
06/26/2018