Defining Quality Requirements for a Trustworthy AI Wildflower Monitoring Platform

by   Petra Heck, et al.

For an AI solution to evolve from a trained machine learning model into a production-ready AI system, many more things need to be considered than just the performance of the machine learning model. A production-ready AI system needs to be trustworthy, i.e. of high quality. But how to determine this in practice? For traditional software, ISO25000 and its predecessors have since long time been used to define and measure quality characteristics. Recently, quality models for AI systems, based on ISO25000, have been introduced. This paper applies one such quality model to a real-life case study: a deep learning platform for monitoring wildflowers. The paper presents three realistic scenarios sketching what it means to respectively use, extend and incrementally improve the deep learning platform for wildflower identification and counting. Next, it is shown how the quality model can be used as a structured dictionary to define quality requirements for data, model and software. Future work remains to extend the quality model with metrics, tools and best practices to aid AI engineering practitioners in implementing trustworthy AI systems.


page 1

page 2

page 3

page 4


Characterizing machine learning process: A maturity framework

Academic literature on machine learning modeling fails to address how to...

Quality Characteristics of a Software Platform for Human-AI Teaming in Smart Manufacturing

As AI-enabled software systems become more prevalent in smart manufactur...

What is Software Quality for AI Engineers? Towards a Thinning of the Fog

It is often overseen that AI-enabled systems are also software systems a...

Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Production

The massive trend of integrating data-driven AI capabilities into tradit...

Priority Quality Attributes for Engineering AI-enabled Systems

Deploying successful software-reliant systems that address their mission...

Dependency, Data and Decolonisation: A Framework for Decolonial Thinking in Collaborative AI Research

This essay seeks to tie together thoughts on the political economy of ac...

Developing an AI-enabled IIoT platform – Lessons learned from early use case validation

For a broader adoption of AI in industrial production, adequate infrastr...

Please sign up or login with your details

Forgot password? Click here to reset