A fast single-image super-resolution method implemented with CUDA | Journal of Real-Time Image Processing Skip to main content

Advertisement

Springer Nature Link
Log in

A fast single-image super-resolution method implemented with CUDA

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Image super-resolution (SR) plays an important role in many areas as it promises to generate high-resolution (HR) images without upgrading image sensors. Many existing SR methods require a large external training set, which would consume a lot of memory. In addition, these methods are usually time-consuming when training model. Moreover, these methods need to retrain model once the magnification factor changes. To overcome these problems, we propose a method, which does not need an external training set by using self-similarity. Firstly, we rotate original low-resolution (LR) image with different angles to expand the training set. Second, multi-scale Difference of Gaussian filters are exploited to obtain multi-view feature maps. Multi-view feature maps could provide an accurate representation of images. Then, feature maps are divided into patches in parallel to build an internal training set. Finally, nonlocal means is applied to each LR patch from original LR image to infer HR patches. In order to accelerate the proposed method by exploiting the computation power of GPU, we implement the proposed method with compute unified device architecture (CUDA). Experimental results validate that the proposed method performs best among the compared methods in both terms of visual perception and objective quantitation. Moreover, the proposed method gets a remarkable speedup after implemented with CUDA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23

Similar content being viewed by others

References

  1. Park, S.C., Park, M.K., Kang, M.G.: Super-resolution image reconstruction: a technical overview. IEEE Signal Process. Mag. 20(3), 21–36 (2003)

    Article  Google Scholar 

  2. Li, X., Hu, Y., Gao, X., Tao, D., Ning, B.: A multi-frame image super-resolution method. Sig. Process. 90(2), 405–414 (2010)

    Article  MATH  Google Scholar 

  3. Aguena, M.L., Mascarenhas, N.D.: Multispectral image data fusion using POCS and super-resolution. Comput. Vis. Image Underst. 102(2), 178–187 (2006)

    Article  Google Scholar 

  4. Qin, F.Q., He, X.H., Chen, W.L., Yang, X.M., Wu, W.: Video superresolution reconstruction based on subpixel registration and iterative back projection. J. Electron. Imaging 18(1), 013007 (2009)

    Article  Google Scholar 

  5. Vrigkas, M., Nikou, C., Kondi, L.P.: Accurate image registration for MAP image super-resolution. Sig. Process. Image Commun. 28(5), 494–508 (2013)

    Article  Google Scholar 

  6. Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: 2009 IEEE 12th International Conference on Computer Vision, pp. 349–356. IEEE (2009)

  7. Kim, K.I., Kwon, Y.: Single-image super-resolution using sparse regression and natural image prior. IEEE Trans. Pattern Anal. Mach. Intell. 32(6), 1127–1133 (2010)

    Article  Google Scholar 

  8. Zeyde, R., Elad, M., Protter, M.: On single image scale-up using sparse-representations. In: International Conference on Curves and Surfaces, pp. 711–730. Springer, Berlin (2010)

  9. Yang, J., Wright, J., Huang, T.S., Ma, Y.: Image super-resolution via sparse representation. IEEE Trans. Image Process. 19(11), 2861–2873 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  10. Yang, X., Wu, W., Liu, K., Chen, W., Zhang, P., Zhou, Z.: Multi-sensor image super-resolution with fuzzy cluster by using multi-scale and multi-view sparse coding for infrared image. Multimed. Tools Appl. 76(2), 1–32 (2017)

    Article  Google Scholar 

  11. Wu, W., Yang, X., Liu, K., Liu, Y., Yan, B.: A new framework for remote sensing image super-resolution: sparse representation-based method by processing dictionaries with multi-type features. J. Syst. Architect. 64, 63–75 (2016)

    Article  Google Scholar 

  12. Dong, C., Loy, C.C., He, K., Tang, X.: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, pp. 184–199. Springer, Cham (2014, September)

  13. Huang, J.B., Singh, A., Ahuja, N.: Single image super-resolution from transformed self-exemplars. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5197–5206 (2015)

  14. Zhou, Z., Wang, Y., Wu, Q.J., Yang, C.N., Sun, X.: Effective and efficient global context verification for image copy detection. IEEE Trans. Inf. Forensics Secur. 12(1), 48–63 (2017)

    Article  Google Scholar 

  15. Li, J., Li, X., Yang, B., Sun, X.: Segmentation-based image copy-move forgery detection scheme. IEEE Trans. Inf. Forensics Secur. 10(3), 507–518 (2015)

    Article  Google Scholar 

  16. Pan, Z., Zhang, Y., Kwong, S.: Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans. Broadcast. 61(2), 166–176 (2015)

    Article  Google Scholar 

  17. Rong, H., Ma, T., Tang, M.: A novel subgraph K+-isomorphism method is social network based on graph similarity detection. Soft. Comput. (2017). https://doi.org/10.1007/s00500-017-2513-y

    Google Scholar 

  18. Zhou, Z., Wu, Q.J., Huang, F., Sun, X.: Fast and accurate near-duplicate image elimination for visual sensor networks. Int. J. Distrib. Sens. Netw. 13(2), 1550147717694172 (2017)

    Article  Google Scholar 

  19. Zhou, Z., Yang, C.N., Chen, B., Sun, X., Liu, Q., Qm, J.: Effective and efficient image copy detection with resistance to arbitrary rotation. IEICE Trans. Inf. Syst. 99(6), 1531–1540 (2016)

    Article  Google Scholar 

  20. Yang, C.Y., Huang, J.B., Yang, M.H.: Exploiting self-similarities for single frame super-resolution. In: Asian Conference on Computer Vision, pp. 497–510. Springer, Berlin (2010)

  21. Suetake, N., Sakano, M., Uchino, E.: Image super-resolution based on local self-similarity. Opt. Rev. 15(1), 26–30 (2008)

    Article  Google Scholar 

  22. Wu, W., Zheng, C.: Single image super-resolution using self-similarity and generalized nonlocal mean. In: TENCON 2013-2013 IEEE Region 10 Conference, pp 1–4. IEEE (2013)

  23. Sun, K.Z., Li, J.D., Xu, S.Y.: Gpu-Accelerated non-local means super-resolution reconstruction. In: Proceedings of the 3rd International Conference on Multimedia Technology, ICMT, pp. 1242–1249 (2013)

  24. Wang, Y.K., Huang, W.B.: A CUDA-enabled parallel algorithm for accelerating retinex. J. Real Time Image Proc. 9(3), 407–425 (2014)

    Article  Google Scholar 

  25. Document Page of Nvidia. http://docs.nvidia.com/cuda/cuda-c-best-practices-guide. Accessed 18 Dec 2017

  26. Home Page of Nvidia. https://developer.nvidia.com/. Accessed 18 Dec 2017

  27. Garcia, V., Debreuve, E., Nielsen, F., Barlaud, M.: K-nearest neighbor search: fast GPU-based implementations and application to high-dimensional feature matching. In: 2010 17th IEEE International Conference on Image Processing (ICIP), pp. 3757–3760. IEEE (2010)

Download references

Acknowledgements

The research in our paper is sponsored by National Natural Science Foundation of China (Nos. 61701327, 61711540303, 61473198), also is supported by the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD) Fund, Jiangsu Collaborative Innovation Center on Atmospheric Environment and Equipment Technology (CICAEET) Fund.

Author information

Authors and Affiliations

  1. College of Electronics and Information Engineering, Sichuan University, Chengdu, 610064, Sichuan, China

    Yuan Yuan, Xiaomin Yang, Wei Wu & Hu Li

  2. College of Computer Science, Sichuan University, Chengdu, 610064, Sichuan, China

    Yiguang Liu

  3. College of Electrical and Engineering Information, Sichuan University, Chengdu, 610064, Sichuan, China

    Kai Liu

Authors
  1. Yuan Yuan
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Xiaomin Yang
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Wei Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Hu Li
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Yiguang Liu
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Kai Liu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Wei Wu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, Y., Yang, X., Wu, W. et al. A fast single-image super-resolution method implemented with CUDA. J Real-Time Image Proc 16, 81–97 (2019). https://doi.org/10.1007/s11554-018-0774-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-018-0774-z

Keywords