Title
A classifier ensemble approach for the missing feature problem
Abstract
Objectives: Many classification problems must deal with data that contains missing values. In such cases data imputation is critical. This paper evaluates the performance of several statistical and machine learning imputation methods, including our novel multiple imputation ensemble approach, using different datasets.
Materials and methods: Several state-of-the-art approaches are compared using different datasets. Some state-of-the-art classifiers (including support vector machines and input decimated ensembles) are tested with several imputation methods. The novel approach proposed in this work is a multiple imputation method based on random subspace, where each missing value is calculated considering a different cluster of the data. We have used a fuzzy clustering approach for the clustering algorithm.
Results: Our experiments have shown that the proposed multiple imputation approach based on clustering and a random subspace classifier outperforms several other state-of-the-art approaches. Using the Wilcoxon signed-rank test (reject the null hypothesis, level of significance 0.05) we have shown that the proposed best approach is outperformed by the classifier trained using the original data (i.e., without missing values) only when >20% of the data are missed. Moreover, we have shown that coupling an imputation method with our cluster based imputation we outperform the base method (level of significance ∼0.05).
Conclusion: Starting from the assumptions that the feature set must be partially redundant and that the redundancy is distributed randomly over the feature set, we have proposed a method that works quite well even when a large percentage of the features is missing (≥30%). Our best approach is available (MATLAB code) at bias.csr.unibo.it/nanni/MI.rar.
Department(s)
Information Technology and Cybersecurity
Document Type
Article
DOI
https://doi.org/10.1016/j.artmed.2011.11.006
Keywords
missing valuesImputation methods, support vector machine, fuzzy clustering, data corruption, equipment malfunctions
Publication Date
2012
Recommended Citation
Nanni, Loris, Alessandra Lumini, and Sheryl Brahnam. "A classifier ensemble approach for the missing feature problem." Artificial intelligence in medicine 55, no. 1 (2012): 37-50.
Journal Title
Artificial intelligence in medicine
