Fast Multi-Hypothesis Motion Compensated Filter for Video Denoising | Journal of Signal Processing Systems Skip to main content
Springer Nature Link
Log in

Fast Multi-Hypothesis Motion Compensated Filter for Video Denoising

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

Multi-Hypothesis motion compensated filter (MHMCF) utilizes a number of hypotheses (temporal predictions) to estimate the current pixel which is corrupted with noise. While showing remarkable denoising results, MHMCF is computationally intensive as full search is employed in the expectation of finding good temporal predictions in the presence of noise. In the frame of MHMCF, a fast denoising algorithm FMHMCF is proposed in this paper. With edge preserved low-pass prefiltering and noise-robust fast multihypothesis search, FMHMCF could find reliable hypotheses while checking very few search locations, so that the denoising process can be dramatically accelerated. Experimental results show that FMHMCF can be 10 to 14 times faster than MHMCF, while achieving the same or even better denoising performance with up to 1.93 dB PSNR (peak-signal-noise-ratio) improvement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9

Similar content being viewed by others

References

  1. Donoho, D. L. (1995). Denoising by soft-thresholding. IEEE Transactions on Information Theory, 41, 613–627.

    Article  MATH  MathSciNet  Google Scholar 

  2. Zhang, S., & Salari, E. (2005). Image denoising using a neural network based non-linear filter in wavelet domain. In Proc. IEEE international conference on acoustic, speech and signal Processing (pp. 989–992), March.

  3. Tschumperle, D., & Deriche, R. (2005). Vector-valued image regularization with PDEs: A common framework for different applications. IEEE Transactions on Pattern Analalysis and Machine Intelligence, 27, 506–517.

    Article  Google Scholar 

  4. Buades, A., Coll, B., & Morel, J. M. (2005). A non-local algorithm for image denoising. In Proc. IEEE computer society conference on computer vision and pattern recognition (pp. 60–65), June.

  5. Woods, J., & Radewan, C. (1977). Kalman filtering in two dimensions. IEEE Transactions on Information Theory, 23, 473–482.

    Article  MATH  MathSciNet  Google Scholar 

  6. Woods, J., & Ingle, V. (1981). Kalman filter in two dimensions: Further results. IEEE Transactions on Acoustics, Speech, and Signal Processing, 29, 188–197.

    Article  MATH  MathSciNet  Google Scholar 

  7. Jin, F., Fieguth, P., Winger, L., & Jernigan, E. (2003). Adaptive Wiener filtering of noisy images and image sequences. In Proc. IEEE international conference on image processing (pp. 349–352), September.

  8. Dubois, E., & Sabri, S. (1984). Noise reduction in image sequences using motion-compensated temporal filtering. IEEE Transactions on Communications, 32, 826–831.

    Article  Google Scholar 

  9. Patti, A. J., Tekalp, A. M., & Sezan, M. I. (1998). A new motion-compensated reduce-order model Kalman filter for space-varying restoration of progressive and interlaced video. IEEE Transactions on Image Processing, 7, 543–554.

    Article  Google Scholar 

  10. Balster, E. J., Zheng, Y. F., & Ewing, R. L. (2006). Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising. IEEE Transactions on Circuits and Systems for Video Technology, 16, 220–230.

    Article  Google Scholar 

  11. Buades, A., Coll, B., & Morel, J. M. (2005). Denoising image sequences does not require motion estimation. In Proc. IEEE international conference on advanced video and signal based surveillance (pp. 70–74), September.

  12. Zlokolica, V., Pitirica, A., & Philips, W. (2004). Recursive temporal denoising and motion estimation of video. In Proc. IEEE international conference on image processing (pp. 1465–1468), October.

  13. Dugad, R., & Ahuja, N. (1999). Video denoising by combining Kalman and Wiener estimates. In Proc. IEEE international conference on image processing (pp. 152–156), October.

  14. Chan, T. W., Au, O. C., Chong, T. S., & Chau, W. S. (2005). A novel content-adaptive video denoising filter. In Proc. IEEE international symposium on circuits and systems (pp. 6060–6283), May.

  15. Mahbubur Rahman, S. M., Omair Ahmad, M., & Swamy, M. N. S. (2007). Video denoising based on inter-frame statistical modeling of wavelet coefficients. IEEE Transactions on Circuits and Systems for Video Technology, 17, 187–198.

    Article  Google Scholar 

  16. Zlokolica, V., Pizurica, A., & Philips, W. (2006). Wavelet-domain video denoising based on reliability measures. IEEE Transactions on Circuits and Systems for Video Technology, 16, 993–1008.

    Article  Google Scholar 

  17. Cheong, H. Y., Tourapis, A. M., Llach, J., & Boyce, J. (2004). Adaptive spatio-temporal filtering for video de-noising. In Proc. IEEE international conference on image processing (pp. 965–968).

  18. Mahmoudi, M., & Sapiro, G. (2005). Fast image and video denoising via nonlocal means of similar neighborhoods. IEEE Signal Processing Letters, 16, 839–843.

    Article  Google Scholar 

  19. Rajpoot, N., Yao, Z., & Wilson, R. (2004) Adaptive wavelet restoration of noisy video sequences. In Proc. IEEE international conference on image processing (pp. 24–27).

  20. Yin, H. B., Fang, X. Z., Wei, Z., & Yang, X. (2007). An improved motion-compensated 3-d llmmse filter with spatioctemporal adaptive filtering support. IEEE Transactions on Circuits and Systems for Video Technology, 17(12), 1714–1727.

    Article  Google Scholar 

  21. Sendur, L., & Selesnick, I. W. (2004). Bivariate shrinkage with local variance estimation. IEEE Signal Processing Letters, 9(12), 438–441.

    Article  Google Scholar 

  22. Sendur, L., & Selesnick, I. W. (2002). Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency. IEEE Transactions on Signal Processing, 50, 2744–2756.

    Article  Google Scholar 

  23. Boo, K. J., & Bose, N. K. (1998). A motion-compensated spatio-temporal filter for image sequences with signal-dependent noise. IEEE Transactions on Circuits and Systems for Video Technology, 8, 287–298.

    Article  Google Scholar 

  24. Brailean, J. C., Kleihorst, R. P., Efstratiadis, S., Katsaggelos, A. K., & Lagendijk, R. L., (1995) Noise reduction filter for dynamic image sequences: A review. In Proc. IEEE (Vol. 83), September.

  25. Flierl, M., & Girod, B. (2004). Video coding with superimposed motion compensation video signals. Boston: Kluwer Academic.

    Google Scholar 

  26. Guo, L. W., Au, O. C., Ma, M. M., Liang, Z. Q., & Yuk, C. (2006). A multihypothesis motion-compensated temporal filter for video denoising. In Proc. Int. Conf. on Image Processing (pp. 1417–1420), October.

Download references

Acknowledgements

This work has been supported in part by the Innovation and Technology Commission of the Hong Kong Special Administrative Region, China (project no GHP/048/08) and the Hong Kong Applied Science and Technology Research Institute (ASTRI).

Author information

Authors and Affiliations

  1. Thomson Corporate Research, Princeton, NJ, 08540, USA

    Liwei Guo

  2. Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong

    Oscar C. Au & Mengyao Ma

  3. Harmonic Inc., Hong Kong, Hong Kong

    Zhiqin Liang

Authors
  1. Liwei Guo
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Oscar C. Au
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Mengyao Ma
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Zhiqin Liang
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Liwei Guo.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Guo, L., Au, O.C., Ma, M. et al. Fast Multi-Hypothesis Motion Compensated Filter for Video Denoising. J Sign Process Syst 60, 273–290 (2010). https://doi.org/10.1007/s11265-009-0365-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-009-0365-0

Keywords