Hybrid Dense Network With Attention Mechanism for Hyperspectral Image Classification

Ahmad, Muhammad; Khan, Adil Mehmood; Mazzara, Manuel; Distefano, Salvatore; Roy, Swalpa Kumar; Wu, Xin

Abstract

The nonlinear relation between the spectral information and the corresponding objects (complex physiognomies) makes pixelwise classification challenging for conventional methods. To deal with nonlinearity issues in hyperspectral image classification (HSIC), convolutional neural networks (CNN) are more suitable, indeed. However, fixed kernel sizes make traditional CNN too specific, neither flexible nor conducive to feature learning, thus impacting on the classification accuracy. The convolution of different kernel size networks may overcome this problem by capturing more discriminating and relevant information. In light of this, the proposed solution aims at combining the core idea of 3-D and 2-D inception net with the attention mechanism to boost the HSIC CNN performance in a hybrid scenario. The resulting attention-fused hybrid network (AfNet) is based on three attention-fused parallel hybrid subnets with different kernels in each block repeatedly using high-level features to enhance the final ground-truth maps. In short, AfNet is able to selectively filter out the discriminative features critical for classification. Several tests on HSI datasets provided competitive results for AfNet compared to state-of-the-art models.

Citation

Ahmad, M., Khan, A. M., Mazzara, M., Distefano, S., Roy, S. K., & Wu, X. (2022). Hybrid Dense Network With Attention Mechanism for Hyperspectral Image Classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 15, 3948-3957. https://doi.org/10.1109/JSTARS.2022.3171586

• Journal Article Type: Article
• Acceptance Date: Apr 22, 2022
• Online Publication Date: May 3, 2022
• Publication Date: Jan 1, 2022
• Deposit Date: Aug 28, 2024
• Publicly Available Date: Sep 3, 2024
• Journal: IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
• Print ISSN: 1939-1404
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Volume: 15
• Pages: 3948-3957
• DOI: https://doi.org/10.1109/JSTARS.2022.3171586
• Keywords: Attention mechanism; Convolutional neural network (CNN); Hyperspectral images classification (HSIC); Inception network
• Public URL: https://hull-repository.worktribe.com/output/4792208