Manuele Bicego
Skip Abstract Section
Abstract
This paper develops and demonstrates an original approach to face-image analysis based on identifying distinctive areas of each individual's face by its comparison to others in the population. The method differs from most others—that we refer as unary—where salient regions are defined by analyzing only images of the same individual. We extract a set of multiscale patches from each face image before projecting them into a common feature space. The degree of “distinctiveness” of any patch depends on its distance in feature space from patches mapped from other individuals. First a pairwise analysis is developed and then a simple generalization to the multiple-face case is proposed. A perceptual experiment, involving 45 observers, indicates the method to be fairly compatible with how humans mark faces as distinct. A quantitative example of face authentication is also performed in order to show the essential role played by the distinctive information. A comparative analysis shows that performance of our n-ary approach is as good as several contemporary unary, or binary, methods, while tapping a complementary source of information. Furthermore, we show it can also provide a useful degree of illumination invariance.
- Adini, Y., Moses, Y., and Ullman, S. 1997. Face recognition: The problem of compensating for changes in illumination direction. IEEE Trans. on Pattern Analysis and Machine Intelligence 19, 7, 721--732.]] Google Scholar
Digital Library
- Agarwal, S. and Roth, D. 2002. Learning a sparse representation for object detection. In Proc. European Conf. on Computer Vision. Vol. 4. 113--130.]] Google ScholarDigital Library
- Bailly-Baillire, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Marithoz, J., Matas, J., Messer, K., Popovici, V., Pore, F., Ruiz, B., and Thiran, J.-P. 2003. The BANCA database and evaluation protocol. In Proc. Int. Conf. on Audio- and Video-Based Biometric Person Authentication (AVBPA03). Springer-Verlag, New York. 625--638.]]Google Scholar
- Belhumeur, P., Hespanha, J. P., and Kreigman, D. J. 1997. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Trans. on Pattern Analysis and Machine Intelligence 19, 7, 711--720.]] Google ScholarDigital Library
- Bengio, S. and Mariétoz, J. 2004. A statistical significance test for person authentication. In Proc. of ODISSEY 2004, Speaker and Language Recognition Workshop. 237--244.]]Google Scholar
- Bicego, M., Grosso, E., and Tistarelli, M. 2005. On finding differences between faces. In Audio- and Video-Based Biometric Person Authentication, T. Kanade, A. Jain, and N. Ratha, Eds. Vol. LNCS 3546. Springer, New York. 329--338.]] Google ScholarDigital Library
- Braccini, C., Gambardella, G., Sandini, G., and Tagliasco, V. 1982. A model of the early stages of the human visual system: Functional and topological transformation performed in the peripheral visual field. Biol. Cybern. 44, 47--58.]]Google ScholarDigital Library
- Brelstaff, G., Ibison, M., and Eliot, P. 1990. Edge-region integration for segmentation of mr images. In Proc. British Machine Vision Conference. 151--156.]]Google Scholar
- Brelstaff, G., Brodo, L., Bicego, M., and Grosso, E. 2006. Face-pair scrutiny—subject-type classification. Perception 35 ECVP Abstract Supplement, 209. ECVP06.]]Google Scholar
- Bruce, V., Valentine, T., and Baddeley, A. 1987. The basis of the 3/4 view advantage in face recognition. Applied Cognitive Psychology 1, 109--120.]]Google ScholarCross Ref
- Bruce, V., Burton, A., and Dench, N. 1994. What's distinctive about a distinctive face? Quarterly Journal of Experimental Psychology 47A, 119--141.]]Google Scholar
- Campadelli, P. and Lanzarotti, R. 2004. Fiducial point localization in color images of face foregrounds. Image and Vision Computing 22, 863--872.]]Google ScholarCross Ref
- Collishaw, S. M. and Hole, G. J. 2000. Featural and configurational processes in the recognition of faces of different familiarity. Perception 29, 893--909.]]Google ScholarCross Ref
- Csurka, G., Dance, C., Bray, C., Fan, L., and Willamowski, J. 2004. Visual categorization with bags of keypoints. In Proc. Workshop Pattern Recognition and Machine Learning in Computer Vision.]]Google Scholar
- Dorko, G. and Schmid, C. 2003. Selection of scale-invariant parts for object class recognition. In Proc. Int. Conf. on Computer Vision. Vol. 1. 634--640.]] Google ScholarDigital Library
- Fergus, R., Perona, P., and Zisserman, A. 2003. Object class recognition by unsupervised scale-invariant learning. In Proc. Int. Conf. on Computer Vision and Pattern Recognition. Vol. 2. 264.]]Google Scholar
- Gauthier, I., Tarr, M., Anderson, A., Skudlarski, P., and Gore, J. 1999. Activation of the middle fusiform “face area” increases with expertise in recognizing novel objects. Nature Neuroscience 2, 568--573.]]Google ScholarCross Ref
- Gonzalez, R. and Woods, R. 2002. Digital Image Processing, 2nd ed. Prentice Hall, Englewood Cliffs, NJ.]] Google ScholarDigital Library
- González-Jiménez, D. and Alba-Castro, J. 2005. Biometrics discriminative face recognition through gabor responses and sketch distortion. In Pattern Recognition and Image Analysis: Second Iberian Conference. Vol. LNCS 3523. Springer-Verlag, New York. 513--520.]] Google ScholarDigital Library
- Goren, C., Sarty, M., and Wu, P. 1975. Visual following and pattern discrimination of face-like stimuli by newborn infants. Pediatrics 56, 544--549.]]Google Scholar
- Gross, R. and Brajovic, V. 2003. An image preprocessing algorithm for illumination invariant face recognition. In Audio- and video-based biometric person authentification, J. Kittler and M. Nixon, Eds. Vol. LNCS 2688. 10--18.]]Google Scholar
- Grosso, E. and Tistarelli, M. 2000. Log-polar stereo for anthropomorphic robots. In Proc. European Conference on Computer Vision. Vol. 1. Springer-Verlag, New York. 299--313.]] Google ScholarDigital Library
- Haith, M., Bergman, T., and Moore, M. 1979. Eye contact and face scanning in early infancy. Science 198, 853--854.]]Google ScholarCross Ref
- Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. on Pattern Analysis and Machine Intelligence 20, 11, 1254--1259.]] Google ScholarDigital Library
- Jojic, N., Frey, B., and Kannan A. 2003. Epitomic analysis of appearance and shape. In Proc. Int. Conf. on Computer Vision. Vol. 1. 34--41.]] Google ScholarDigital Library
- Kim, J., Choi, J., Yi, J., and Turk, M. 2005. Effective representation using ica for face recognition robust to local distortion and partial occlusion. IEEE Trans. on Pattern Analysis and Machine Intelligence 27, 12, 1977--1981.]] Google ScholarDigital Library
- Kirby, M. and Sirovich, L. 1990. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Trans. on Pattern Analysis and Machine Intelligence 12, 1, 103--108.]] Google ScholarDigital Library
- Klin, A. 2001. Eye-tracking of social stimuli in adults with autism. Paper presented at the meeting of the NICHD Collaborative Program of Excellence in Autism. Yale University, New Haven, CT.]]Google Scholar
- Koch, C. and Ullman, S. 1985. Shifts in selective visual-attention ñ towards the underlying neural circuitry. Human Neurobiology 4, 219--227.]]Google Scholar
- Li, S., Hou, X., and Zhang, H. 2001. Learning spatially localized, parts-based representation. Computer Vision and Image Understanding 1, 207--212.]]Google Scholar
- Lindeberg, T. 1993. Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention. Int. Journal of Computer Vision 11, 3, 283--318.]] Google ScholarDigital Library
- Lowe, D. 2004. Distinctive image features from scale-invariant keypoints. Int. Journal of Computer Vision 60, 2, 91--110.]] Google ScholarDigital Library
- Maio, D., Maltoni, D., Jain, A. K., and Prabhakar, S. 2003. Handbook of Fingerprint Recognition. Springer Verlag, New York.]] Google ScholarDigital Library
- Marr, D. 1982. Vision. Freeman, San Francisco, CA.]]Google Scholar
- Messer, K., Matas, J., Kittler, J., Luettin, J., and Maitre, G. 1997. XM2VTSDB: The extended M2VTS database. In Proc. Int. Conf. on Audio and Video-Based Biometric Person Authentication.]]Google Scholar
- Ming-Hsuan, Y., Kriegman, D., and Ahuja, N. 2002. Detecting faces in images: a survey. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 3458.]] Google ScholarDigital Library
- Nahm, F., Perret, A., Amaral, D., and Albright, T. 1997. How do monkeys look at faces? Journal of Cognitive Neuroscience 9, 611--623.]] Google ScholarDigital Library
- O'Toole, A. 2004. Psychological and neural perspectives. In Handbook of Face Recognition, S. Li and A. Jain, Eds. Springer-Verlag, New York. 2005.]]Google Scholar
- O'Toole, A., Jiang, F., Abdi, H., and Haxby, J. 2005. Partially distributed representations of objects and faces in ventral temporal cortex. Journal of Cognitive Neuroscience 17, 4, 580--590.]] Google ScholarDigital Library
- O'Toole, A., Jiang, F., Roark, D., and Abdi, H. 2006. Predicting human performance for face recognition. In Face Processing: Advanced models and methods, R. Chellappa and W. Zhao, Eds. Academic Press, New York. in press.]]Google Scholar
- Penev, P. and Atick, J. 1996. Local feature analysis: a general statistical theory for object representation. Network: computation in Neural Systems 7, 3, 477--500.]]Google Scholar
- Perlibakas, V. 2004. Distance measures for PCA-based face recognition. Pattern Recognition Letters 25, 6, 711--724.]] Google ScholarDigital Library
- Phillips, P., Scruggs, P. F. T., Bowyer, K., Chang, J., Hoffman, K., an J. Min, J. M., and Worek, W. 2005. Overview of the face recognition grand challenge. In Proc. of IEEE Int. Conf. on Computer Vision and Pattern Recognition. Vol. 1. 947--954.]] Google ScholarDigital Library
- Salah, A., Alpaydin, E., and Akarun, L. 2002. A selective attention-based method for visual pattern recognition with application to handwritten digit recognition and face recognition. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 3, 420--425.]] Google ScholarDigital Library
- Senior, A. 1999. Face and feature finding for a face recognition system. In Proc. of Audio- and Video-based Biometric Person Authentication. 154--159.]]Google Scholar
- Tistarelli, M. and Sandini, G. 1993. On the advantages of polar and log-polar mapping for direct estimation of time-to-impact from optical flow. IEEE Trans. on Pattern Analysis and Machine Intelligence 15, 4, 401--410.]] Google ScholarDigital Library
- Tsotsos, J., Culhane, S., Wai, W., Lai, Y., Davis, N., and Nuflo, F. 1995. Modelling visual attention via selective tuning. Artificial Intelligence 78, 507--545.]] Google ScholarDigital Library
- Turk, M. and Pentland, A. 1991. Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 1, 71--86.]] Google ScholarDigital Library
- Ullman, S., Vidal-Naquet, M., and Sali, E. 2002. Visual features of intermediate complexity and their use in classification. Nature Neuroscience 5, 682--687.]]Google ScholarCross Ref
- Walther, D. 2006. Interactions of visual attention and object recognition: computational modeling, algorithms, and psychophysics. Ph.D. thesis, Pasadena, CA.]]Google Scholar
- Wiskott, L., Fellous, J.-M., and der Malsburg, C. V. 1997. Face recognition by elastic bunch graph matching. IEEE Trans. on Pattern Analysis and Machine Intelligence 19, 775--779.]] Google ScholarDigital Library
- Yarbus, A. 1967. Eye Movements and Vision. Plenum Press, New York.]]Google Scholar
- Zhao, W., Chellappa, R., Phillips, P., and Rosenfeld, A. 2003. Face recognition: A literature survey. ACM Computing Surveys 35, 399--458.]] Google ScholarDigital Library
Index Terms
- Distinctiveness of faces: A computational approach
Recommendations
2D Pose-Invariant Face Recognition Using Single Frontal-View Face Database
AbstractPersonal identification systems that use face recognition work well for test images with frontal view face, but often fail when the input face is a pose view. Most face databases come from picture ID sources such as passports or driver’s licenses. ...
Face recognition performance comparison between fake faces and live faces
Face recognition is a widely used biometric technology because it is both user friendly and more convenient to use than other biometric approaches. However, naïve face recognition systems that do not support any type of liveness detection can be easily ...
Fast features for face authentication under illumination direction changes
In this letter we propose a facial feature extraction technique which utilizes polynomial coefficients derived from 2D Discrete Cosine Transform (DCT) coefficients obtained from horizontally and vertically neighbouring blocks. Face authentication ...
Comments