Visual saliency in noisy images
- PMID: 23479475
- DOI: 10.1167/13.4.5
Visual saliency in noisy images
Abstract
The human visual system possesses the remarkable ability to pick out salient objects in images. Even more impressive is its ability to do the very same in the presence of disturbances. In particular, the ability persists despite the presence of noise, poor weather, and other impediments to perfect vision. Meanwhile, noise can significantly degrade the accuracy of automated computational saliency detection algorithms. In this article, we set out to remedy this shortcoming. Existing computational saliency models generally assume that the given image is clean, and a fundamental and explicit treatment of saliency in noisy images is missing from the literature. Here we propose a novel and statistically sound method for estimating saliency based on a nonparametric regression framework and investigate the stability of saliency models for noisy images and analyze how state-of-the-art computational models respond to noisy visual stimuli. The proposed model of saliency at a pixel of interest is a data-dependent weighted average of dissimilarities between a center patch around that pixel and other patches. To further enhance the degree of accuracy in predicting the human fixations and of stability to noise, we incorporate a global and multiscale approach by extending the local analysis window to the entire input image, even further to multiple scaled copies of the image. Our method consistently outperforms six other state-of-the-art models (Bruce & Tsotsos, 2009; Garcia-Diaz, Fdez-Vidal, Pardo, & Dosil, 2012; Goferman, Zelnik-Manor, & Tal, 2010; Hou & Zhang, 2007; Seo & Milanfar, 2009; Zhang, Tong, & Marks, 2008) for both noise-free and noisy cases.
Similar articles
-
What stands out in a scene? A study of human explicit saliency judgment.Vision Res. 2013 Oct 18;91:62-77. doi: 10.1016/j.visres.2013.07.016. Epub 2013 Aug 15. Vision Res. 2013. PMID: 23954536
-
Static and space-time visual saliency detection by self-resemblance.J Vis. 2009 Nov 20;9(12):15.1-27. doi: 10.1167/9.12.15. J Vis. 2009. PMID: 20053106
-
Removing label ambiguity in learning-based visual saliency estimation.IEEE Trans Image Process. 2012 Apr;21(4):1513-25. doi: 10.1109/TIP.2011.2179665. Epub 2011 Dec 13. IEEE Trans Image Process. 2012. PMID: 22180509
-
On the plausibility of the discriminant center-surround hypothesis for visual saliency.J Vis. 2008 Jun 13;8(7):13.1-18. doi: 10.1167/8.7.13. J Vis. 2008. PMID: 19146246 Review.
-
Visual saliency and spike timing in the ventral visual pathway.J Physiol Paris. 2003 Mar-May;97(2-3):365-77. doi: 10.1016/j.jphysparis.2003.09.010. J Physiol Paris. 2003. PMID: 14766152 Review.
Cited by
-
What do saliency models predict?J Vis. 2014 Mar 11;14(3):14. doi: 10.1167/14.3.14. J Vis. 2014. PMID: 24618107 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous