Components of Machine Learning: Binding Bits and FLOPS

10/25/2019
by   Alexander Jung, et al.
0

Many machine learning problems and methods are combinations of three components: data, hypothesis space and loss function. Different machine learning methods are obtained as combinations of different choices for the representation of data, hypothesis space and loss function. After reviewing the mathematical structure of these three components, we discuss intrinsic trade-offs between statistical and computational properties of ML methods.

READ FULL TEXT
research
08/21/2018

Wrapped Loss Function for Regularizing Nonconforming Residual Distributions

Multi-output is essential in machine learning that it might suffer from ...
research
01/23/2023

Towards Modular Machine Learning Solution Development: Benefits and Trade-offs

Machine learning technologies have demonstrated immense capabilities in ...
research
01/02/2020

A Loss-Function for Causal Machine-Learning

Causal machine-learning is about predicting the net-effect (true-lift) o...
research
05/28/2019

Machine Learning on data with sPlot background subtraction

Data analysis in high energy physics has to deal with data samples produ...
research
09/19/2023

Mean Absolute Directional Loss as a New Loss Function for Machine Learning Problems in Algorithmic Investment Strategies

This paper investigates the issue of an adequate loss function in the op...
research
01/21/2020

Designing for the Long Tail of Machine Learning

Recent technical advances has made machine learning (ML) a promising com...
research
12/29/2021

PowerGraph: Using neural networks and principal components to multivariate statistical power trade-offs

It is increasingly acknowledged that a priori statistical power estimati...

Please sign up or login with your details

Forgot password? Click here to reset