Hyperspectral Image Reconstruction for SD-CASSI Systems Based on Residual Attention Network | SpringerLink
Skip to main content

Hyperspectral Image Reconstruction for SD-CASSI Systems Based on Residual Attention Network

  • Conference paper
  • First Online:
Algorithmic Aspects in Information and Management (AAIM 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13513))

Included in the following conference series:

  • 644 Accesses

Abstract

Hyperspectral images contain both spatial and spectral information, which can be utilized to material identification. Therefore, they find significant advantages in object detection. Hyperspectral images are also believed to play an important part in geological survey and material classification. As the resolution of hyperspectral images increases, compressed sensing (CS) is proposed to reduce the data size, resulting in lower system latency. However, images after CS require reconstruction for further applications such as object detection. The idea of numerical optimization is adopted by conventional reconstruction algorithms. However, these algorithms are time-consuming in iteration. The efficiency and resulting image quality are also not satisfying. Therefore, deep neural networks (DNN) are expected to make better reconstruction algorithms. This paper proposes a novel reconstruction algorithm for hyperspectral images based on deep learning. The core idea is to apply a residual attention network. Firstly, convolution layers of different reception fields are applied to extract different features in hyperspectral images. Then the residual attention blocks satisfying the channel attention mechanism explore the inter-spectral correlation of hyperspectral images. Our proposed reconstruction model is tested to be effective and efficiency in experiments. Compared to three conventional algorithms, OMP, TwIST and GPSR, the proposed algorithm improves PSNR by over 8 db and reconstruction speed by 7 times. Moreover, the model achieves better reconstruction performance compared to a DNN-based model DNNnet.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 5719
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 7149
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Hyperspectral Image – an overview | ScienceDirect Topics. https://www.sciencedirect.com/topics/computer-science/hyperspectral-image. Accessed 7 June 2022

  2. Donoho, D.L.: Compressed sensing. IEEE Trans. Inf. Theory 52(4), 1289–1306 (2006)

    Article  MathSciNet  Google Scholar 

  3. Candès, E.J., Romberg, J., Tao, T.: Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 52(2), 489–509 (2006)

    Article  MathSciNet  Google Scholar 

  4. Nyquist rate – Wikipedia. https://en.wikipedia.org/wiki/Nyquist_rate. Accessed 7 June 2022

  5. Liu, Y., et al.: A novel method of coded-aperture push-broom Compton scatter imaging: principles, simulations and experiments. Nucl. Instrum. Methods Phys. Res., Sect. A 1(940), 30–39 (2019)

    Article  Google Scholar 

  6. Wei, K., Fu, Y., Huang, H.: 3-D quasi-recurrent neural network for hyperspectral image denoising. IEEE Trans. Neural Netw. Learn. Syst. 32(1), 363–375 (2020)

    Article  Google Scholar 

  7. Qing, Y., Liu, W.: Hyperspectral image classification based on multi-scale residual network with attention mechanism. Remote Sens. 13(3), 335 (2021)

    Article  MathSciNet  Google Scholar 

  8. Zhao, M., Yue, L., Hu, J., Du, S., Li, P., Wang, L.: Salient target detection in hyperspectral image based on visual attention. IET Image Proc. 15(10), 2301–2308 (2021)

    Article  Google Scholar 

  9. Davenport, M.A., Wakin, M.B.: Analysis of orthogonal matching pursuit using the restricted isometry property. IEEE Trans. Inf. Theory 56(9), 4395–4401 (2010)

    Article  MathSciNet  Google Scholar 

  10. Bioucas-Dias, J.M., Figueiredo, M.A.: A new TwIST: two-step iterative shrinkage/thresholding algorithms for image restoration. IEEE Trans. Image Process. 16(12), 2992–3004 (2007)

    Article  MathSciNet  Google Scholar 

  11. Chen, G., Li, D., Zhang, J.: Iterative gradient projection algorithm for two-dimensional compressive sensing sparse image reconstruction. Signal Process. 1(104), 15–26 (2014)

    Article  Google Scholar 

  12. Wang, L., Zhang, T., Fu, Y., Huang, H.: Hyperreconnet: Joint coded aperture optimization and image reconstruction for compressive hyperspectral imaging. IEEE Trans. Image Process. 28(5), 2257–2270 (2018)

    Article  MathSciNet  Google Scholar 

  13. Yilin, J., Ran, S., Sanqiang, T.: Generative adversarial networks for hyperspectral image spatial super-resolution. J. China Univ. Posts Telecommun. 27(4), 8 (2020)

    Google Scholar 

  14. Choi, I., Kim, M.H., Gutierrez, D., Jeon, D.S., Nam, G.: High-quality hyperspectral reconstruction using a spectral prior (2017)

    Google Scholar 

  15. Miao, X., Yuan, X., Pu, Y., Athitsos, V.: lambda-net: reconstruct hyperspectral images from a snapshot measurement. In 2019 IEEE InCVF International Conference on Computer Vision (ICCV), pp. 4058–4068 (2019)

    Google Scholar 

  16. Arad, B., Ben-Shahar, O.: Sparse recovery of hyperspectral signal from natural RGB images. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. LNCS, vol. 9911, pp. 19–34. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46478-7_2

    Chapter  Google Scholar 

  17. Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. Adv. Neural Inf. Process. Syst. 32, 1–14 (2019)

    Google Scholar 

  18. Multiframe Coded Aperture Spectral Imaging (CASSI) | Duke Information Spaces Project. https://disp.duke.edu/research/multiframe-coded-aperture-spectral-imaging-cassi. Accessed 7 June 2022

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Haobin Luo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Luo, H., Su, G., Wang, Y., Zhang, J., Dong, L. (2022). Hyperspectral Image Reconstruction for SD-CASSI Systems Based on Residual Attention Network. In: Ni, Q., Wu, W. (eds) Algorithmic Aspects in Information and Management. AAIM 2022. Lecture Notes in Computer Science, vol 13513. Springer, Cham. https://doi.org/10.1007/978-3-031-16081-3_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-16081-3_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-16080-6

  • Online ISBN: 978-3-031-16081-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics