Issues in the mining of heart failure datasets
Poolsawad, Nongnuch; Moore, Lisa; Kambhampati, Chandrasekhar; Cleland, John G.F.
Dr Chandrasekhar Kambhampati C.Kambhampati@hull.ac.uk
Reader in Computer Science
John G.F. Cleland
This paper investigates the characteristics of a clinical dataset using a combination of feature selection and classification methods to handle missing values and understand the underlying statistical characteristics of a typical clinical dataset. Typically, when a large clinical dataset is presented, it consists of challenges such as missing values, high dimensionality, and unbalanced classes. These pose an inherent problem when implementing feature selection and classification algorithms. With most clinical datasets, an initial exploration of the dataset is carried out, and those attributes with more than a certain percentage of missing values are eliminated from the dataset. Later, with the help of missing value imputation, feature selection and classification algorithms, prognostic and diagnostic models are developed. This paper has two main conclusions: 1) Despite the nature of clinical datasets, and their large size, methods for missing value imputation do not affect the final performance. What is crucial is that the dataset is an accurate representation of the clinical problem and those methods of imputing missing values are not critical for developing classifiers and prognostic/diagnostic models. 2) Supervised learning ha s proven to be more suitable for mining clinical data than unsupervised methods. It is also shown that non-parametric classifiers such as decision trees give better results when compared to parametric classifiers such as radial basis function networks (RBFNs). © 2014 Institute of Automation, Chinese Academy of Sciences and Springer-Verlag Berlin Heidelberg.
|Journal Article Type||Article|
|Journal||International Journal of Automation and Computing|
|Peer Reviewed||Peer Reviewed|
|APA6 Citation||Poolsawad, N., Moore, L., Kambhampati, C., & Cleland, J. G. (2014). Issues in the mining of heart failure datasets. International Journal of Automation and Computing, 11(2), 162-179. https://doi.org/10.1007/s11633-014-0778-5|
|Keywords||Heart failure; Clinical dataset; Classification; Clustering; Missing values; Feature selection|
You might also like
Ionic Imbalances and Coupling in Synchronization of Responses in Neurons
A comparative study of missing value imputation with multiclass classification for clinical heart failure data
A numerical model for Hodgkin-Huxley neural stimulus reconstruction