Open Access Research Article

View Influence Analysis and Optimization for Multiview Face Recognition

Won-Sook Lee1* and Kyung-Ah Sohn2

Author Affiliations

1 School of Information Technology and Engineering, University of Ottawa, Ottawa K1N6N5, Canada

2 Computer Science Department, Carnegie Mellon University, Pittsburgh, PA 15213-3891, USA

For all author emails, please log on.

EURASIP Journal on Image and Video Processing 2007, 2007:025409  doi:10.1155/2007/25409

Published: 23 August 2007


We present a novel method to recognize a multiview face (i.e., to recognize a face under different views) through optimization of multiple single-view face recognitions. Many current face descriptors show quite satisfactory results to recognize identity of people with given limited view (especially for the frontal view), but the full view of the human head has not yet been recognizable with commercially acceptable accuracy. As there are various single-view recognition techniques already developed for very high success rate, for instance, MPEG-7 advanced face recognizer, we propose a new paradigm to facilitate multiview face recognition, not through a multiview face recognizer, but through multiple single-view recognizers. To retrieve faces in any view from a registered descriptor, we need to give corresponding view information to the descriptor. As the descriptor needs to provide any requested view in 3D space, we refer to it as "3D" information that it needs to contain. Our analysis in various angled views checks the extent of each view influence and it provides a way to recognize a face through optimized integration of single view descriptors covering the view plane of horizontal rotation from −90∘ to 90∘ and vertical rotation from −30∘ to 30∘. The resulting face descriptor based on multiple representative views, which is of compact size, shows reasonable face recognition performance on any view. Hence, our face descriptor contains quite enough 3D information of a person's face to help for recognition and eventually for search, retrieval, and browsing of photographs, videos, and 3D-facial model databases.