Integrating monolithic and free-parts representations for improved face verification in the presence of pose mismatch

Abstract

This paper concentrates specifically on the task of verifying faces when the gallery set stems from frontal face images with the probe set stemming from a number of alternate poses (i.e. pose mismatch). An argument is put forward for attempting to recognize faces through integrating holistic/monolithic and free-parts representations of the face. A contribution is made via the analysis of what traits, in a face, are most useful for each representation. As a result we are able to demonstrate that there is: (a) benefit in combining free-parts and monolithic representations, and (b) further benefit can be obtained by varying the weight placed on each representation as a function of viewpoint.