Issues in the mining of heart failure datasets
Poolsawad, Nongnuch; Moore, Lisa; Kambhampati, Chandrasekhar; Cleland, John G.F.
Dr Chandrasekhar Kambhampati C.Kambhampati@hull.ac.uk
Reader in Computer Science
John G.F. Cleland
This paper investigates the characteristics of a clinical dataset using a combination of feature selection and classification methods to handle missing values and understand the underlying statistical characteristics of a typical clinical dataset. Typically, when a large clinical dataset is presented, it consists of challenges such as missing values, high dimensionality, and unbalanced classes. These pose an inherent problem when implementing feature selection and classification algorithms. With most clinical datasets, an initial exploration of the dataset is carried out, and those attributes with more than a certain percentage of missing values are eliminated from the dataset. Later, with the help of missing value imputation, feature selection and classification algorithms, prognostic and diagnostic models are developed. This paper has two main conclusions: 1) Despite the nature of clinical datasets, and their large size, methods for missing value imputation do not affect the final performance. What is crucial is that the dataset is an accurate representation of the clinical problem and those methods of imputing missing values are not critical for developing classifiers and prognostic/diagnostic models. 2) Supervised learning ha s proven to be more suitable for mining clinical data than unsupervised methods. It is also shown that non-parametric classifiers such as decision trees give better results when compared to parametric classifiers such as radial basis function networks (RBFNs). © 2014 Institute of Automation, Chinese Academy of Sciences and Springer-Verlag Berlin Heidelberg.
Poolsawad, N., Moore, L., Kambhampati, C., & Cleland, J. G. (2014). Issues in the mining of heart failure datasets. International Journal of Automation and Computing, 11(2), 162-179. https://doi.org/10.1007/s11633-014-0778-5
|Journal Article Type||Article|
|Acceptance Date||Jul 18, 2013|
|Online Publication Date||Mar 12, 2015|
|Deposit Date||Jan 2, 2019|
|Journal||International Journal of Automation and Computing|
|Peer Reviewed||Peer Reviewed|
|Keywords||Heart failure; Clinical dataset; Classification; Clustering; Missing values; Feature selection|
This file is under embargo due to copyright reasons.
Contact P.Doyle@hull.ac.uk to request a copy for personal use.
You might also like
Ionic Imbalances and Coupling in Synchronization of Responses in Neurons
A comparative study of missing value imputation with multiclass classification for clinical heart failure data
A numerical model for Hodgkin-Huxley neural stimulus reconstruction