Abstract
Hyperspectral images contain both spatial and spectral information, which can be utilized to material identification. Therefore, they find significant advantages in object detection. Hyperspectral images are also believed to play an important part in geological survey and material classification. As the resolution of hyperspectral images increases, compressed sensing (CS) is proposed to reduce the data size, resulting in lower system latency. However, images after CS require reconstruction for further applications such as object detection. The idea of numerical optimization is adopted by conventional reconstruction algorithms. However, these algorithms are time-consuming in iteration. The efficiency and resulting image quality are also not satisfying. Therefore, deep neural networks (DNN) are expected to make better reconstruction algorithms. This paper proposes a novel reconstruction algorithm for hyperspectral images based on deep learning. The core idea is to apply a residual attention network. Firstly, convolution layers of different reception fields are applied to extract different features in hyperspectral images. Then the residual attention blocks satisfying the channel attention mechanism explore the inter-spectral correlation of hyperspectral images. Our proposed reconstruction model is tested to be effective and efficiency in experiments. Compared to three conventional algorithms, OMP, TwIST and GPSR, the proposed algorithm improves PSNR by over 8 db and reconstruction speed by 7 times. Moreover, the model achieves better reconstruction performance compared to a DNN-based model DNNnet.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Hyperspectral Image – an overview | ScienceDirect Topics. https://www.sciencedirect.com/topics/computer-science/hyperspectral-image. Accessed 7 June 2022
Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006)
Candès, E.J., Romberg, J., Tao, T.: Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52(2), 489–509 (2006)
Nyquist rate – Wikipedia. https://en.wikipedia.org/wiki/Nyquist_rate. Accessed 7 June 2022
Liu, Y., et al.: A novel method of coded-aperture push-broom Compton scatter imaging: principles, simulations and experiments. Nucl. Instrum. Methods Phys. Res., Sect. A 1(940), 30–39 (2019)
Wei, K., Fu, Y., Huang, H.: 3-D quasi-recurrent neural network for hyperspectral image denoising. IEEE Trans. Neural Netw. Learn. Syst. 32(1), 363–375 (2020)
Qing, Y., Liu, W.: Hyperspectral image classification based on multi-scale residual network with attention mechanism. Remote Sens. 13(3), 335 (2021)
Zhao, M., Yue, L., Hu, J., Du, S., Li, P., Wang, L.: Salient target detection in hyperspectral image based on visual attention. IET Image Proc. 15(10), 2301–2308 (2021)
Davenport, M.A., Wakin, M.B.: Analysis of orthogonal matching pursuit using the restricted isometry property. IEEE Trans. Inf. Theory 56(9), 4395–4401 (2010)
Bioucas-Dias, J.M., Figueiredo, M.A.: A new TwIST: two-step iterative shrinkage/thresholding algorithms for image restoration. IEEE Trans. Image Process. 16(12), 2992–3004 (2007)
Chen, G., Li, D., Zhang, J.: Iterative gradient projection algorithm for two-dimensional compressive sensing sparse image reconstruction. Signal Process. 1(104), 15–26 (2014)
Wang, L., Zhang, T., Fu, Y., Huang, H.: Hyperreconnet: Joint coded aperture optimization and image reconstruction for compressive hyperspectral imaging. IEEE Trans. Image Process. 28(5), 2257–2270 (2018)
Yilin, J., Ran, S., Sanqiang, T.: Generative adversarial networks for hyperspectral image spatial super-resolution. J. China Univ. Posts Telecommun. 27(4), 8 (2020)
Choi, I., Kim, M.H., Gutierrez, D., Jeon, D.S., Nam, G.: High-quality hyperspectral reconstruction using a spectral prior (2017)
Miao, X., Yuan, X., Pu, Y., Athitsos, V.: lambda-net: reconstruct hyperspectral images from a snapshot measurement. In 2019 IEEE InCVF International Conference on Computer Vision (ICCV), pp. 4058–4068 (2019)
Arad, B., Ben-Shahar, O.: Sparse recovery of hyperspectral signal from natural RGB images. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. LNCS, vol. 9911, pp. 19–34. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46478-7_2
Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. Adv. Neural Inf. Process. Syst. 32, 1–14 (2019)
Multiframe Coded Aperture Spectral Imaging (CASSI) | Duke Information Spaces Project. https://disp.duke.edu/research/multiframe-coded-aperture-spectral-imaging-cassi. Accessed 7 June 2022
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Luo, H., Su, G., Wang, Y., Zhang, J., Dong, L. (2022). Hyperspectral Image Reconstruction for SD-CASSI Systems Based on Residual Attention Network. In: Ni, Q., Wu, W. (eds) Algorithmic Aspects in Information and Management. AAIM 2022. Lecture Notes in Computer Science, vol 13513. Springer, Cham. https://doi.org/10.1007/978-3-031-16081-3_41
Download citation
DOI: https://doi.org/10.1007/978-3-031-16081-3_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16080-6
Online ISBN: 978-3-031-16081-3
eBook Packages: Computer ScienceComputer Science (R0)