Abstract
For humans, faces are highly overlearned stimuli, which are encountered in everyday life in all kinds of poses and views. Using psychophysics we investigated the effects of viewpoint on human face recognition. The experimental paradigm is modeled after the inter-extra-ortho experiment using unfamiliar objects by Bülthoff and Edelman [5]. Our results show a strong viewpoint effect for face recognition, which replicates the earlier findings and provides important insights into the biological plausibility of view-based recognition approaches (alignment of a 3D model, linear combination of 2D views and view-interpolation). We then compared human recognition performance to a novel computational view-based approach [29] and discuss improvements of view-based algorithms using local part-based information.
Christian Wallraven and Adrian Schwaninger were supported by a grant from the European Community (CogVis).
However, it is interesting that Biederman and Kalocsai [3] point out that face recognition — as opposed to object recognition — cannot be understood by RBC theory mainly because recognizing faces entails processing holistic surface based information.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Biederman, I. (1987). Recognition-by-components: A theory of human image understanding. Psychological Review, 94(2), 115–147.
Biederman, I., Gerhardstein, P.C. (1993). Recognizing depth-rotated objects: evidence and conditions for three-dimensional viewpoint invariance. Journal of Experimental Psychology: Human Perception and Performance, 19, 6, 1162–1182.
Biederman, I., Kalocsai, P. (1997). Neurocomputational bases of object and face recognition. Philosophical Transactions of the Royal Society London, B, 352, 1203–1219.
Blanz, V., Vetter, T. (1999). A Morphable Model for the Synthesis of 3D Faces. In Proc. Siggraph99, pp. 187–194.
Bülthoff, H.H., Edelman, S. (1992). Psychophysical support for a two-dimensional view interpolation theory of object recognition. PNAS USA, 89, 60–64.
Collishaw, S.M., Hole G.J. (2000). Featural and configurational processes in the recognition of faces of different familiarity. Perception, 29, 893–910.
Edelman, S., Bülthoff, H, H. (1992). Orientation dependence in the recognition of familiar and novel views of three-dimensional objects. Vision Research, 32(12), 2385–4000.
Edelman, S. Intrator, N. (2000). A productive, systematic framework for the representation of visual structure. In Proc. NIPS 2000, 10–16.
Goren, C., Sarty, M., Wu, P. (1975). Visual following and pattern discrimination of facelike stimuli by newborn infants. Pediatrics, 56, 544–549.
Heisele, B., Serre, T., Pontil, M., Vetter, T., and Poggio, T. (2001). Categorization by learning and combining object parts. In Proc. NIPS 2001.
Hummel, J.E., Biederman, I. (1992). Dynamic binding in a neural network for shape recognition. Psychological Review, 99(3), 480–517.
Lee, D., Seung S. (1999). Learning the parts of objects by non-negative matrix factorization. Nature, 401:788–791.
Leder, H., Candrian, G., Huber, O., Bruce, V. (2001). Configural features in the context of upright and inverted faces. Perception, 30, 73–83.
Lowe, D.G. (1985). Perceptual organization and visual recognition. Boston: Kluwer Academic Publishing.
Lowe, D.G. (1987). Three-dimensional object recognition from single two-dimensional images. Artificial Intelligence, 31, 355–395.
Marr, D. (1982). Vision. San Francisco: Freeman.
Morton, J., Johnson, M.H. (1991). CONSPEC and CONLERN: A two-process theory of infant face recognition. Psychological Review, 98, 164–181.
O'Toole, A. J., Edelman, S., Bülthoff H.H. (1998). Stimulus-specific effects in face recognition over changes in viewpoint. Vision Research, 38, 2351–2363.
Poggio T, Edelman S. (1990) A network that learns to recognize three-dimensional objects. Nature, 18, 343(6255), 263–266.
Pilu, M. (1997). A direct method for stereo correspondence based on singular value decomposition, In Proc. CVPR’97, 261–266.
Schwaninger, A., Mast, F. (1999). Why is face recognition so orientation-sensitive? Psychophysical evidence for an integrative model. Perception, 28 (Suppl.), 116.
Sergent J. (1985). Influence of task and input factors on hemispheric involvement in face processing. Journal of Experimental Psychology: Human Perception and Performance, 11(6), 846–61.
Schyns, P. G., Rodet, L. (1997) Categorization creates functional features. Journal of Experimental Psychology: Learning, Memory and Cognition, 23, 681–696.
Troje, N. F., Bülthoff, H.H. (1996). Face recognition under varying pose: the role of texture and shape. Vision Research, 36, 1761–1771.
Ullman, S., Basri, R. (1991). Recognition by linear combinations of models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(10), 992–1006.
Ullman, S., Sali, E. (2000). Object Classification Using a Fragment-Based Representation. In Proc. BMCV’00, 73–87.
Valentin, D., Abdi, H., Edelman, B. (1999). From rotation to disfiguration: Testing a dual-strategy model for recognition of faces across view angles. Perception, 28, 817–824.
Wallis, G. M., Bülthoff, H.H. (2001). Effect of temporal association on recognition memory. PNAS USA, 98, 4800–4804.
Wallraven, C., Bülthoff, H.H. (2001). Automatic acquisition of exemplar-based representations for recognition from image sequences. CVPR 2001 — Workshop on Models vs. Exemplars.
Wallraven, C., Bülthoff, H.H. (2001). View-based recognition under illumination changes using local features. CVPR 2001—Workshop on Identifying Objects Across Variations in Lighting: Psychophysics and Computation.
Weber M., Welling M. and Perona P. (2000). Unsupervised Learning of Models for Recognition. In Proc. ECCV2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wallraven, C., Schwaninger, A., Schuhmacher, S., Bülthoff, H.H. (2002). View-Based Recognition of Faces in Man and Machine: Re-visiting Inter-extra-Ortho. In: Bülthoff, H.H., Wallraven, C., Lee, SW., Poggio, T.A. (eds) Biologically Motivated Computer Vision. BMCV 2002. Lecture Notes in Computer Science, vol 2525. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36181-2_65
Download citation
DOI: https://doi.org/10.1007/3-540-36181-2_65
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00174-4
Online ISBN: 978-3-540-36181-7
eBook Packages: Springer Book Archive