dacl1k: Real-World Bridge Damage Dataset Putting Open-Source Data to the Test

by   Johannes Flotzinger, et al.

Recognising reinforced concrete defects (RCDs) is a crucial element for determining the structural integrity, traffic safety and durability of bridges. However, most of the existing datasets in the RCD domain are derived from a small number of bridges acquired in specific camera poses, lighting conditions and with fixed hardware. These limitations question the usability of models trained on such open-source data in real-world scenarios. We address this problem by testing such models on our "dacl1k" dataset, a highly diverse RCD dataset for multi-label classification based on building inspections including 1,474 images. Thereby, we trained the models on different combinations of open-source data (meta datasets) which were subsequently evaluated both extrinsically and intrinsically. During extrinsic evaluation, we report metrics on dacl1k and the meta datasets. The performance analysis on dacl1k shows practical usability of the meta data, where the best model shows an Exact Match Ratio of 32 the bottleneck features of the best model derived from the extrinsic evaluation in order to find out, if the model has learned distinguishing datasets or the classes (RCDs) which is the aspired goal. The dacl1k dataset and our trained models will be made publicly available, enabling researchers and practitioners to put their models to the real-world test.


page 2

page 12


dacl10k: Benchmark for Semantic Bridge Damage Segmentation

Reliably identifying reinforced concrete defects (RCDs)plays a crucial r...

An Ample Approach to Data and Modeling

In the present work, we describe a framework for modeling how models can...

Current Trends in Deep Learning for Earth Observation: An Open-source Benchmark Arena for Image Classification

We present 'AiTLAS: Benchmark Arena' – an open-source benchmark framewor...

Balancing Transparency and Risk: The Security and Privacy Risks of Open-Source Machine Learning Models

The field of artificial intelligence (AI) has experienced remarkable pro...

Towards Better Instruction Following Language Models for Chinese: Investigating the Impact of Training Data and Evaluation

Recently, significant public efforts have been directed towards developi...

SuperCaustics: Real-time, open-source simulation of transparent objects for deep learning applications

Transparent objects are a very challenging problem in computer vision. T...

Monolingual and Cross-Lingual Knowledge Transfer for Topic Classification

This article investigates the knowledge transfer from the RuQTopics data...

Please sign up or login with your details

Forgot password? Click here to reset