Abstract
The computation of optical flow has been proposed as a pre-processing step for many high-level vision algorithms. One of the main approaches to the optical flow problem is the gradient-based approach which differentiates the image intensity to compute the optical flow. Often motion vectors computed using various approaches are not reliable. Spatial smoothing of the image sequence is advisable in order to improve velocity estimates in the presence of noise. That is, the application of some kind of linear operation to the images in the sequence before solving for the flow. The pre-processing typically takes the form of some type of spatial Gaussian smoothing or scale specific band-pass filtering of the input images. The main objectives of such filtering have been to lessen the effects of noise, to isolate image structure of interest and to attenuate temporal aliasing and quantization effects in the input images.
This paper investigates the effect of presmoothing on this computation of optical flow. The well known method of Horn and Schunck as well as our own finite element method are implemented and tested for improvements due to presmoothing. Discussions are provided on the effects of presmoothing for a variety of image sequences. In our experiments, smoothing is carried out on a selection of well known sequences in both time and space. Improvements are shown using presmoothing.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Barron, J.L., Fleet, D.J., Beauchemin, S.S.: Performance of Optical Flow Techniques. IJCV 12(1), 43–77 (1994)
Black, M.J., Anandan, P.: The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields. Comp. Vision and Image Understanding 63(1), 75–104 (1996)
Chin, T.M., Karl, W.C., Willsky, A.S.: Probabilistic and Sequential Computation of Optical Flow using Temporal Coherence. IEEE Transactions on Image Process 3(6), 773–788 (1994)
Cohen, I., Herlin, I.: Non Uniform Multiresolution Method for Optical Flow and Phase Portrait Models: Environmental Applications. IJCV 33(1), 1–22 (1999)
Condell, J.V.: Motion Tracking in Digital Images . Ph.D Thesis, Faculty of Informatics, University of Ulster (2002)
Condell, J.V., Scotney, B.W., Morrow, P.J.: Adaptive Grid Refinement Procedures for Efficient Optical Flow Computation. IJCV 61(1), 31–54 (2005)
Graham, J.V., Scotney, B.W., Morrow, P.J.: Evaluation of Inverse Finite Element Techniques for Gradient Based Motion Estimation. In: Proc. Third IMA Confer. on Imaging and Digital Image Process, pp. 200–220 (2000)
Heeger, D.J.: Model for the Extraction of Image Flow. Jnl. of Optical Society of America A: Optics. Image Science and Vision 4(8), 1455–1471 (1987)
Horn, B.K.P., Schunck, B.G.: Determining Optical Flow. AI 17, 185–203 (1981)
Ju, S.X., Black, M.J., Jepson, A.D.: Skin and Bones: Multilayer, Locally Affine, Optical Flow and Regularisation with Transparency. In: IEEE Proc. Intern. Confer. on Comp. Vision and Pattern Recognition (CVPR 1996), pp. 307–314 (1996)
Nomura, A.: Spatio-Temporal Optimization Method for Determining Motion Vector Fields Under Non-Stationary Illumination. Image and Vision Computing 18, 939–950 (2000)
Ong, E.P., Spann, M.: Robust Optical Flow Computation based on Least-Median-of-Squares Regression. IJCV 31(1), 51–82 (1999)
Schunck, B.G.: The Motion Constraint Equation for Optical Flow. In: IEEE Proc. Seventh Intern. Confer. on Pattern Recognition (ICPR 1984), vol. 1, 2, pp. 20–22 (1984)
Simoncelli, E.P., Adelson, E.H., Heeger, D.J.: Probability Distributions of Optical Flow. In: IEEE Proc. Intern. Confer. on Comp. Vision and Pattern Recognition (CVPR 1991), pp. 310–315 (1991)
Sim, D.G., Park, R.H.: A Two-Stage Algorithm for Motion Discontinuity-Preserving Optical Flow Estimation. In: IEEE Proc. Intern. Confer. on Comp. Vision and Pattern Recognition (CVPR 1997), vol. 1, pp. 19–37 (1997)
Zhang, L., Sakurai, T., Miike, H.: Detection of Motion Fields under Spatio Temporal Non-Uniform Illumination. Image and Vision Computing 17, 309–320 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Condell, J.V., Scotney, B.W., Morrow, P.J. (2006). The Effect of Presmoothing Image Sequences on the Computation of Optical Flow. In: Campilho, A., Kamel, M.S. (eds) Image Analysis and Recognition. ICIAR 2006. Lecture Notes in Computer Science, vol 4141. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11867586_71
Download citation
DOI: https://doi.org/10.1007/11867586_71
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44891-4
Online ISBN: 978-3-540-44893-8
eBook Packages: Computer ScienceComputer Science (R0)