Abstract
In a scene observed from a fixed viewpoint, the set of shadow curves in an image changes as a point light source (nearby or at infinity) assumes different locations. We show that for any finite set of point light sources illuminating an object viewed under either orthographic or perspective projection, there is an equivalence class of object shapes having the same set of shadows. Members of this equivalence class differ by a four parameter family of projective transformations, and the shadows of a transformed object are identical when the same transformation is applied to the light source locations. Under orthographic projection, this family is the generalized basrelief (GBR) transformation, and we show that the GBR transformation is the only family of transformations of an object's shape for which the complete set of imaged shadows is identical. Finally, we show that given multiple images under differing and unknown light source directions, it is possible to reconstruct an object up to these transformations from the shadows alone.
Chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
E. Artin. Geometric Algebra. Interscience Publishers, Inc., New York, 1957.
M. Baxandall. Shadows and Enlightenment. Yale University Press, New Haven, 1995.
P. Belhumeur, D. Kriegman, and A. Yuille. The bas-relief ambiguity. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog., pages 1040–1046, 1997.
P. N. Belhumeur and D. J. Kriegman. What is the set of images of an object under all possible lighting conditions. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog., pages 270–277, 1996.
P. Breton and S. Zucker. Shadows and shading flow fields. In CVPR96, pages 782–789, 1996.
F. Cheng and K. Thiel. Delimiting the building heights in a city from the shadow in a panchromatic spot-image. 1 test of 42 buildings. JRS, 16(3):409–415, Feb. 1995.
B. F. Cook. The Elgin Marbles. Harvard University Press, Cambridge, 1984.
L. Donati and N. Stolfi. Singularities of illuminated surfaces. Int. J. Computer Vision, 23(3):207–216, 1997.
O. Faugeras. Stratification of 3-D vision: Projective, affine, and metric representations. J. Opt. Soc. Am. A, 12(7):465–484, 1995.
C. Fermuller and Y. Aloimonos. Ordinal representations of visual space. In Proc. Image Understanding Workshop, pages 897–904, 1996.
L. Hambrick, M. Loew, and R. Carroll, Jr. The entry-exit method of shadow boundary segmentation. PAMI, 9(5):597–607, September 1987.
M. Hatzitheodorou. The derivation of 3-d surface shape from shadows. In Proc. Image Understanding Workshop, pages 1012–1020, 1989.
A. Huertas and R. Nevatia. Detection of buildings in aerial images using shape and shadows. In Proc. Int. Joint Conf. on Art. Intell., pages 1099–1103, 1983.
R. Irvin and D. McKeown. Methods for exploiting the relationship between buildings and their shadows in aerial imagery. IEEE Systems, Man, and Cybernetics, 19(6):1564–1575, 1989.
M. Kemp, editor. Leonardo On Painting. Yale University Press, New Haven, 1989.
M. Kemp. The Science of Art: Optical Themes in Western Art from Brunelleschi to Seurat. Yale University Press, New Haven, 1990.
J. Kender and E. Smith. Shape from darkness. In Int. Conf. on Computer Vision, pages 539–546, 1987.
J. Koenderink and A. Van Doom. Affine structure from motion. JOSA-A, 8(2):377–385, 1991.
M. Langer and S. Zucker. What is a light source? In Proc. IEEE Conf. on Comp. Vision and Patt. Recog., pages 172–178, 1997.
G. Medioni. Obtaining 3-d from shadows in aerial images. In CVPR83, pages 73–76, 1983.
J. Mundy and A. Zisserman. Geometric invariance in computer vision. MIT Press, 1992.
R. Rosenholtz and J. Koenderink. Affine structure and photometry. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog., pages 790–795, 1996.
S. Shafer and T. Kanade. Using shadows in finding surface orientation. Comp. Vision, Graphics, and Image Proces., 22(1):145–176, 1983.
L. Shapiro, A. Zisserman, and M. Brady. 3D motion recovery via affine epipolar geometry. Int. J. Computer Vision, 16(2):147–182, October 1995.
A. Shashua. Geometry and Photometry in 3D Visual Recognition. PhD thesis, MIT, 1992.
S. Ullman and R. Basri. Recognition by a linear combination of models. IEEE Trans. Pattern Anal. Mach. Intelligence, 13:992–1006, 1991.
D. L. Waltz. Understanding line drawings of scenes with shadows. In P. Winston, editor, The Psychology of Computer Vision, pages 19–91. McGraw-Hill, New York, 1975.
A. Witkin. Intensity-based edge classification. In Proc. Am. Assoc. Art. Intell., pages 36–41, 1982.
D. Yang and J. Kender. Shape from shadows under error. In Proc. Image Understanding Workshop, pages 1083–1090, 1993.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kriegman, D.J., Belhumeur, P.N. (1998). What shadows reveal about object structure. In: Burkhardt, H., Neumann, B. (eds) Computer Vision — ECCV’98. ECCV 1998. Lecture Notes in Computer Science, vol 1407. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0054755
Download citation
DOI: https://doi.org/10.1007/BFb0054755
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64613-6
Online ISBN: 978-3-540-69235-5
eBook Packages: Springer Book Archive