A Disjoint Samples-Based 3D-CNN With Active Transfer Learning for Hyperspectral Image Classification

Ahmad, Muhammad; Ghous, Usman; Hong, Danfeng; Khan, Adil Mehmood; Yao, Jing; Wang, Shaohua; Chanussot, Jocelyn

Abstract

Convolutional neural networks (CNNs) have been extensively studied for hyperspectral image classification (HSIC). However, CNNs are critically attributed to a large number of labeled training samples, which outlays high costs in terms of time and resources. Moreover, CNNs are trained on some samples and have been tested on the entire HSI. Perhaps, the entire HSI is taken into account at test time to appropriately generate the ground-truth maps. To obtain a higher accuracy while considering the limited availability of training samples and disjoint validation and test samples, this work proposes a fast and compact 3-D CNN-based active learning (AL) for HSIC that integrates both deep transfer learning and AL into a unified framework. In the proposed methodology, a 3-D CNN model is trained with very few training samples (i.e., 5%, only) and in the next phase, the most informative and heterogeneous samples are queried from the validation set (candidate set) based on the fuzziness, mutual information, and breaking ties of the trained model. The 3-D CNN model is later fine-tuned (rather than retraining from scratch) with the new training samples (i.e., 200 samples are selected in each iteration) to reduce the computational cost. The proposed method has been compared with the state-of-the-art traditional and deep models proposed for HSIC. Experimental results proved the superiority of our proposed method on several benchmark HSI datasets with significantly fewer labeled samples. MATLAB demo can be accessed on GitHub: github.com/mahmad00

Citation

Ahmad, M., Ghous, U., Hong, D., Khan, A. M., Yao, J., Wang, S., & Chanussot, J. (2022). A Disjoint Samples-Based 3D-CNN With Active Transfer Learning for Hyperspectral Image Classification. IEEE transactions on geoscience and remote sensing : a publication of the IEEE Geoscience and Remote Sensing Society, 60, 1-16. https://doi.org/10.1109/TGRS.2022.3209182

• Journal Article Type: Article
• Acceptance Date: Sep 16, 2022
• Online Publication Date: Sep 26, 2022
• Publication Date: 2022
• Deposit Date: Dec 1, 2023
• Publicly Available Date: Feb 26, 2024
• Journal: IEEE Transactions on Geoscience and Remote Sensing
• Print ISSN: 0196-2892
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 60
• Article Number: 5539616
• Pages: 1-16
• DOI: https://doi.org/10.1109/TGRS.2022.3209182
• Keywords: 3-D convolutional neural network (3-D CNN); Active learning (AL); Hyperspectral image classification (HSIC); Spatial-spectral information; Transfer learning
• Public URL: https://hull-repository.worktribe.com/output/4399876