Depth Functions for Partial Orders with a Descriptive Analysis of Machine Learning Algorithms

by   Hannah Blocher, et al.
Universität München

We propose a framework for descriptively analyzing sets of partial orders based on the concept of depth functions. Despite intensive studies of depth functions in linear and metric spaces, there is very little discussion on depth functions for non-standard data types such as partial orders. We introduce an adaptation of the well-known simplicial depth to the set of all partial orders, the union-free generic (ufg) depth. Moreover, we utilize our ufg depth for a comparison of machine learning algorithms based on multidimensional performance measures. Concretely, we analyze the distribution of different classifier performances over a sample of standard benchmark data sets. Our results promisingly demonstrate that our approach differs substantially from existing benchmarking approaches and, therefore, adds a new perspective to the vivid debate on the comparison of classifiers.


page 1

page 2

page 3

page 4


A note on the connectedness property of union-free generic sets of partial orders

This short note describes and proves a connectedness property which was ...

Choice functions based on sets of strict partial orders: an axiomatic characterisation

Methods for choosing from a set of options are often based on a strict p...

Password Guessers Under a Microscope: An In-Depth Analysis to Inform Deployments

Password guessers are instrumental for assessing the strength of passwor...

Partial reconstruction of measures from halfspace depth

The halfspace depth of a d-dimensional point x with respect to a finite ...

Functorial Manifold Learning and Overlapping Clustering

We adapt previous research on topological unsupervised learning to devel...

Comparison of pharmacist evaluation of medication orders with predictions of a machine learning model

The objective of this work was to assess the clinical performance of an ...

Statistical Comparisons of Classifiers by Generalized Stochastic Dominance

Although being a question in the very methodological core of machine lea...

Please sign up or login with your details

Forgot password? Click here to reset