Visual saliency based on scale-space analysis in the frequency domain
- PMID: 22802112
- DOI: 10.1109/TPAMI.2012.147
Visual saliency based on scale-space analysis in the frequency domain
Abstract
We address the issue of visual saliency from three perspectives. First, we consider saliency detection as a frequency domain analysis problem. Second, we achieve this by employing the concept of nonsaliency. Third, we simultaneously consider the detection of salient regions of different size. The paper proposes a new bottom-up paradigm for detecting visual saliency, characterized by a scale-space analysis of the amplitude spectrum of natural images. We show that the convolution of the image amplitude spectrum with a low-pass Gaussian kernel of an appropriate scale is equivalent to an image saliency detector. The saliency map is obtained by reconstructing the 2D signal using the original phase and the amplitude spectrum, filtered at a scale selected by minimizing saliency map entropy. A Hypercomplex Fourier Transform performs the analysis in the frequency domain. Using available databases, we demonstrate experimentally that the proposed model can predict human fixation data. We also introduce a new image database and use it to show that the saliency detector can highlight both small and large salient regions, as well as inhibit repeated distractors in cluttered images. In addition, we show that it is able to predict salient regions on which people focus their attention.
Similar articles
-
BIK-BUS: biologically motivated 3D keypoint based on bottom-up saliency.IEEE Trans Image Process. 2015 Jan;24(1):163-75. doi: 10.1109/TIP.2014.2371532. Epub 2014 Nov 20. IEEE Trans Image Process. 2015. PMID: 25420258
-
A unified spectral-domain approach for saliency detection and its application to automatic object segmentation.IEEE Trans Image Process. 2012 Mar;21(3):1272-83. doi: 10.1109/TIP.2011.2164420. Epub 2011 Aug 12. IEEE Trans Image Process. 2012. PMID: 21843989
-
Visual attention on the sphere.IEEE Trans Image Process. 2008 Nov;17(11):2000-14. doi: 10.1109/TIP.2008.2003415. IEEE Trans Image Process. 2008. PMID: 18854253
-
Visual saliency and spike timing in the ventral visual pathway.J Physiol Paris. 2003 Mar-May;97(2-3):365-77. doi: 10.1016/j.jphysparis.2003.09.010. J Physiol Paris. 2003. PMID: 14766152 Review.
-
Computational modelling of visual attention.Nat Rev Neurosci. 2001 Mar;2(3):194-203. doi: 10.1038/35058500. Nat Rev Neurosci. 2001. PMID: 11256080 Review.
Cited by
-
Cascaded Aggregation Convolution Network for Salient Grain Pests Detection.Insects. 2024 Jul 22;15(7):557. doi: 10.3390/insects15070557. Insects. 2024. PMID: 39057289 Free PMC article.
-
Intra-Oral Photograph Analysis for Gingivitis Screening in Orthodontic Patients.Int J Environ Res Public Health. 2023 Feb 19;20(4):3705. doi: 10.3390/ijerph20043705. Int J Environ Res Public Health. 2023. PMID: 36834398 Free PMC article.
-
Crosstalk Defect Detection Method Based on Salient Color Channel Frequency Domain Filtering.Sensors (Basel). 2022 Jul 20;22(14):5426. doi: 10.3390/s22145426. Sensors (Basel). 2022. PMID: 35891104 Free PMC article.
-
Dual Attention-Based Industrial Surface Defect Detection with Consistency Loss.Sensors (Basel). 2022 Jul 8;22(14):5141. doi: 10.3390/s22145141. Sensors (Basel). 2022. PMID: 35890821 Free PMC article.
-
Feature Refine Network for Salient Object Detection.Sensors (Basel). 2022 Jun 14;22(12):4490. doi: 10.3390/s22124490. Sensors (Basel). 2022. PMID: 35746271 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources