Metrics to guide a multi-objective evolutionary algorithm for ordinal classification
Hits: 10937
- Áreas de investigación:
- Año:
- 2014
- Tipo de publicación:
- Artículo
- Palabras clave:
- Mean absolute error,Multi-objective evolutionary algorithm,Ordinal measures,Ordinal classification,Ordinal regression,Proportional odds model
- Autores:
- Journal:
- Neurocomputing
- Volumen:
- 135
- Páginas:
- 21-31
- Mes:
- July
- ISSN:
- 0925-2312
- Nota:
- JCR(2014): 2.083 Position: 36/123 (Q2) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
- Abstract:
- Ordinal classification or ordinal regression are classification problems in which the labels have an ordered arrangement between them. Due to this order, alternative performance evaluation metrics are need to be used in order to consider the magnitude of errors. This paper presents an study of the use of a multi-objective optimization approach in the context of ordinal classification. We contribute a study of ordinal classification performance metrics, and propose a new performance metric, the Maximum Mean Absolute Error (MMAE). MMAE considers per-class distribution of patterns and the magnitude of the errors, both issues being crucial for ordinal regression problems. In addition we empirically show that some of the performance metrics are competitive objectives, which justifies the use of multi-objective optimization strategies. In our case, a multi-objective evolutionary algorithm optimizes a artificial neural network ordinal model with different pairs of metrics combinations, and we conclude that the pair of the Mean Absolute Error (MAE) and the proposed MMAE is the most favorable. A study of the relationship between the metrics of this proposal is performed, and the graphical representation in the 2 dimensional space where the search of the evolutionary algorithm takes place is analyzed. The results obtained show a good classification performance, opening new lines of research in the evaluation and model selection of ordinal classifiers.
- Comentarios:
- JCR(2014): 2.083 Position: 36/123 (Q2) Category: COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
