Soft labelling based on triangular distributions for ordinal classification

Research areas:

• Methodology - Ordinal classification
• Methodology - Convolutional Neural Networks

Year:

2023

Type of Publication:

Article

Keywords:

unimodal regularisation, deep learning, triangular distribution, ordinal loss

Authors:

• Vargas, Víctor Manuel
• Gutiérrez, Pedro Antonio
• Barbero-Gómez, Javier
• Hervás-Martínez, César

Journal:

Information Fusion

Volume:

93

Pages:

258-267

Month:

May

ISSN:

1566-2535

BibTex:

@article{INFFusVictor2023, author = "V{\'i}ctor Manuel Vargas and Pedro Antonio Guti{\'e}rrez and Javier Barbero-G{\'o}mez and C{\'e}sar Herv{\'a}s-Mart{\'i}nez", abstract = "Recently, solving ordinal classification problems using machine learning and deep learning techniques has acquired important attention. There are many real-world problems in different areas of knowledge where a categorical variable needs to be predicted, and the existing categories follow an order associated with the nature of the problem: e.g. medical diagnosis with different states of a disease, or industrial quality assessment with different levels of quality. In these problems, it is quite common that the final label for each sample is determined by a group of experts with different opinions, and all opinions are usually summarised in a single crisp label by means of a given statistic (e.g. the median or the mode). Applying standard ordinal classifiers to these crisp labels could result in overfitting, as the labelling information is considered as totally certain. In this work, we propose a unimodal regularisation approach based on soft labelling, i.e. the ordinal information is used to introduce the inherent uncertainty of the label fusion. Specifically, said regularisation is based on using triangular distributions to simulate the aforementioned fusion of the expert opinions, where a parameter is used to decide the amount of probability that is assigned to the target category and the adjacent ones (according to the ordinal scale). The strategy could be applied to the loss function used by any ordinal classification learning algorithm, but we focus on deep learning in this paper. The proposal is compared to a baseline approach for nominal classification tasks and other state-of-the-art unimodal regularisation methods, and the experimental validation includes six benchmark datasets and five performance metrics. The results along with the statistical analysis show that the proposed methodology significantly outperforms the rest of the methods.", awards = "JCR(2023): 14.7 Position: 2/143 (Q1) Category: COMPUTER SCIENCE, THEORY {\&}amp; METHODS", comments = "JCR(2023): 14.7 Position: 2/143 (Q1) Category: COMPUTER SCIENCE, THEORY {\&}amp; METHODS", doi = "10.1016/j.inffus.2023.01.003", issn = "1566-2535", journal = "Information Fusion", keywords = "unimodal regularisation, deep learning, triangular distribution, ordinal loss", month = "May", note = "JCR(2023): 14.7 Position: 2/143 (Q1) Category: COMPUTER SCIENCE, THEORY {\&}amp; METHODS", pages = "258-267", title = "{S}oft labelling based on triangular distributions for ordinal classification", url = "dx.doi.org/10.1016/j.inffus.2023.01.003", volume = "93", year = "2023", }

Note:

JCR(2023): 14.7 Position: 2/143 (Q1) Category: COMPUTER SCIENCE, THEORY & METHODS

Abstract:

Recently, solving ordinal classification problems using machine learning and deep learning techniques has acquired important attention. There are many real-world problems in different areas of knowledge where a categorical variable needs to be predicted, and the existing categories follow an order associated with the nature of the problem: e.g. medical diagnosis with different states of a disease, or industrial quality assessment with different levels of quality. In these problems, it is quite common that the final label for each sample is determined by a group of experts with different opinions, and all opinions are usually summarised in a single crisp label by means of a given statistic (e.g. the median or the mode). Applying standard ordinal classifiers to these crisp labels could result in overfitting, as the labelling information is considered as totally certain. In this work, we propose a unimodal regularisation approach based on soft labelling, i.e. the ordinal information is used to introduce the inherent uncertainty of the label fusion. Specifically, said regularisation is based on using triangular distributions to simulate the aforementioned fusion of the expert opinions, where a parameter is used to decide the amount of probability that is assigned to the target category and the adjacent ones (according to the ordinal scale). The strategy could be applied to the loss function used by any ordinal classification learning algorithm, but we focus on deep learning in this paper. The proposal is compared to a baseline approach for nominal classification tasks and other state-of-the-art unimodal regularisation methods, and the experimental validation includes six benchmark datasets and five performance metrics. The results along with the statistical analysis show that the proposed methodology significantly outperforms the rest of the methods.

Comments:

JCR(2023): 14.7 Position: 2/143 (Q1) Category: COMPUTER SCIENCE, THEORY & METHODS