Semi-Supervised Learning For Ordinal Kernel Discriminant Analysis

Research areas:

• Methodology - Machine learning

Year:

2016

Type of Publication:

Article

Keywords:

Ordinal regression, Discriminant analysis, Semi-supervised learning, Classification, Kernel learning

Authors:

• Pérez-Ortiz, María
• Gutiérrez, Pedro Antonio
• Carbonero-Ruz, Mariano
• Hervás-Martínez, César

Journal:

Neural Networks

Volume:

84

Pages:

57-66

Month:

December

ISSN:

0893-6080

Note:

JCR(2016): 5.287 Position: 10/133 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE

Abstract:

Ordinal classification considers those classification problems where the labels of the variable to predict follow a given order. Naturally, labelled data is scarce or difficult to obtain in this type of problems because, in many cases, ordinal labels are given by an user or expert (e.g. in recommendation systems). Firstly, this paper develops a new strategy for ordinal classification where both labelled and unlabelled data are used in the model construction step (a scheme which is referred to as semi-supervised learning). More specifically, the ordinal version of kernel discriminant learning is extended for this setting considering the neighbourhood information of unlabelled data, which is proposed to be computed in the feature space induced by the kernel function. Secondly, a new method for semi-supervised kernel learning is devised in the context of ordinal classification, which is combined with our developed classification strategy to optimise the kernel parameters. The experiments conducted compare 6 different approaches for semi-supervised learning in the context of ordinal classification in a battery of 30 datasets, showing (1) the good synergy of the ordinal version of discriminant analysis and the use of unlabelled data and (2) the advantage of computing distances in the feature space induced by the kernel function.

Comments:

JCR(2016): 5.287 Position: 10/133 (Q1) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE