Machine Learning with the Sugeno Integral: The Case of Binary Classification

by   Sadegh Abbaszadeh, et al.

In this paper, we elaborate on the use of the Sugeno integral in the context of machine learning. More specifically, we propose a method for binary classification, in which the Sugeno integral is used as an aggregation function that combines several local evaluations of an instance, pertaining to different features or measurements, into a single global evaluation. Due to the specific nature of the Sugeno integral, this approach is especially suitable for learning from ordinal data, that is, when measurements are taken from ordinal scales. This is a topic that has not received much attention in machine learning so far. The core of the learning problem itself consists of identifying the capacity underlying the Sugeno integral. To tackle this problem, we develop an algorithm based on linear programming. The algorithm also includes a suitable technique for transforming the original feature values into local evaluations (local utility scores), as well as a method for tuning a threshold on the global evaluation. To control the flexibility of the classifier and mitigate the problem of overfitting the training data, we generalize our approach toward k-maxitive capacities, where k plays the role of a hyper-parameter of the learner. We present experimental studies, in which we compare our method with competing approaches on several benchmark data sets.


page 1

page 2

page 3

page 4


A Binary Classification Framework for Two-Stage Multiple Kernel Learning

With the advent of kernel methods, automating the task of specifying a s...

Enhanced version of AdaBoostM1 with J48 Tree learning method

Machine Learning focuses on the construction and study of systems that c...

Hierarchical Collaborative Hyper-parameter Tuning

Hyper-parameter Tuning is among the most critical stages in building mac...

Deep kernel learning for integral measurements

Deep kernel learning refers to a Gaussian process that incorporates neur...

Rolling Lookahead Learning for Optimal Classification Trees

Classification trees continue to be widely adopted in machine learning a...

Joint aggregation of cardinal and ordinal evaluations with an application to a student paper competition

An important problem in decision theory concerns the aggregation of indi...

Choquet integral in decision analysis - lessons from the axiomatization

The Choquet integral is a powerful aggregation operator which lists many...

Please sign up or login with your details

Forgot password? Click here to reset