Ordinal regression neural networks based on concentric hyperspheres

Research areas:

• Methodology - Machine learning

Year:

2014

Type of Publication:

Article

Keywords:

Ordinal regression, ordinal classification, neural networks, latent variable

Authors:

• Gutiérrez, Pedro Antonio
• Tino, Peter
• Hervás-Martínez, César

Journal:

Neural Networks

Volume:

59

Pages:

51-60

Month:

November

ISSN:

0893-6080

BibTex:

@article{Neunet2014, author = "Pedro Antonio Guti{\'e}rrez and Peter Tino and C{\'e}sar Herv{\'a}s-Mart{\'i}nez", abstract = "Threshold models are one of the most common approaches for ordinal regression, based on projecting patterns to the real line and dividing this real line in consecutive intervals, one interval for each class. However, finding such one-dimensional projection can be too harsh an imposition for some datasets. This paper proposes a multidimensional latent space representation with the purpose of relaxing this projection, where the different classes are arranged based on concentric hyperspheres, each class containing the previous classes in the ordinal scale. The proposal is implemented through a neural network model, each dimension being a linear combination of a common set of basis functions. The model is compared to a nominal neural network, a neural network based on the proportional odds model and to other state-of-the-art ordinal regression methods for a total of 12 datasets. The proposed latent space shows an improvement on the two performance metrics considered, and the model based on the three-dimensional latent space obtains competitive performance when compared to the other methods.", awards = "JCR(2014): 2.708 Position: 18/123 (Q1) Category: ENGINEERING, MULTIDISCIPLINARY", comments = "JCR(2014): 2.708 Position: 18/123 (Q1) Category: ENGINEERING, MULTIDISCIPLINARY", doi = "10.1016/j.neunet.2014.07.001", issn = "0893-6080", journal = "Neural Networks", keywords = "Ordinal regression, ordinal classification, neural networks, latent variable", month = "November", note = "JCR(2014): 2.708 Position: 18/123 (Q1) Category: ENGINEERING, MULTIDISCIPLINARY", pages = "51--60", title = "{O}rdinal regression neural networks based on concentric hyperspheres", url = "dx.doi.org/10.1016/j.neunet.2014.07.001", volume = "59", year = "2014", }

Note:

JCR(2014): 2.708 Position: 18/123 (Q1) Category: ENGINEERING, MULTIDISCIPLINARY

Abstract:

Threshold models are one of the most common approaches for ordinal regression, based on projecting patterns to the real line and dividing this real line in consecutive intervals, one interval for each class. However, finding such one-dimensional projection can be too harsh an imposition for some datasets. This paper proposes a multidimensional latent space representation with the purpose of relaxing this projection, where the different classes are arranged based on concentric hyperspheres, each class containing the previous classes in the ordinal scale. The proposal is implemented through a neural network model, each dimension being a linear combination of a common set of basis functions. The model is compared to a nominal neural network, a neural network based on the proportional odds model and to other state-of-the-art ordinal regression methods for a total of 12 datasets. The proposed latent space shows an improvement on the two performance metrics considered, and the model based on the three-dimensional latent space obtains competitive performance when compared to the other methods.

Comments:

JCR(2014): 2.708 Position: 18/123 (Q1) Category: ENGINEERING, MULTIDISCIPLINARY