3D Face Modeling, Analysis and Recognition

Presents methodologies for modeling, analysis and recognition of shapes of facial surfaces, from fundamental ideas in geometry and shape analysis, to cutting-edge applications This text presents methodologies for analyzing shapes of facial surfaces, develops computational tools for analyzing 3D face data, and illustrates them using state-of-the-art applications. The methodologies chosen are based on efficient representations, metrics, comparisons, and classifications of features that are especially relevant in the context of 3D measurements of human faces. These frameworks have a long-term utility in face analysis, taking into account the anticipated improvements in data collection, data storage, processing speeds, and application scenarios expected as the discipline develops further. Covers a wide range of applications including biometrics, 3D animation, facial surgery, forensics, and video communications. Contains numerous exercises and algorithms. Covers the fundamentals and methodologies of 3D face analysis Includes a section specifically on applications, making the book of interest to both those in research and industry. Brings together information currently available in disparate sources in a much-needed comprehensive textbook. All methods are tested on FRGC or subsets of FRGC datasets, allowing a comparison on a single dataset A companion website hosts updates, information on relevant databases, and demonstrations.

Table of Contents:
Preface List of Contributors 1 3D Face Modeling Boulbaba Ben Amor, Mohsen Ardabilian and Liming Chen 1.1 Challenges and Taxonomy of Techniques 1.2 Background 1.2.1 Depth from Triangulation 1.2.2 Shape from Shading 1.2.3 Depth from Time of Flight (ToF) 1.3 Static 3D Face Modeling 1.3.1 Laser-stripe Scanning 1.3.2 Time-coded Structured Light 1.3.3 Multiview Static Reconstruction 1.4 Dynamic 3D Face Reconstruction 1.4.1 Multiview Dynamic Reconstruction 1.4.2 Photometric Stereo 1.4.3 Structured Light 1.4.4 Spacetime Faces 1.4.5 Template-based Post-processing 1.5 Summary and Conclusions Exercises References 2 3D Face Surface Analysis and Recognition Based on Facial Surface Features Faisal Radhi M. Al-Osaimi and Mohammed Bennammoun 2.1 Geometry of 3D Facial Surface 2.1.1 Primary 3D Surface Representations 2.1.2 Rigid 3D Transformations 2.1.3 Decimation of 3D Surfaces 2.1.4 Geometric and Topological Aspects of the Human Face 2.2 Curvatures Extraction from 3D Face Surface 2.2.1 Theoretical Concepts on 3D Curvatures 2.2.2 Practical Curvature Extraction Methods 2.3 3D Face Segmentation 2.3.1 Curvature-based 3D Face Segmentation 2.3.2 Bilateral Profile-based 3D Face Segmentation 2.4 3D Face Surface Feature Extraction and Matching 2.4.1 Holistic 3D Facial Features 2.4.2 Regional 3D Facial Features 2.4.3 Point 3D Facial Features 2.5 Deformation Modeling of 3D Face Surface Exercises References 3 3D Face Surface Analysis and Recognition Based on Facial Curves Hassen Drira, Stefano Berretti, Boulbaba Ben Amor, Mohamed Daoudi, Anuj Srivastava, Alberto del Bimbo and Pietro Pala 3.1 Introduction 3.2 Facial Surface Modeling 3.3 Parametric Representation of Curves 3.4 Facial Shape Representation Using Radial Curves 3.5 Shape Space of Open Curves 3.5.1 Shape Representation 3.5.2 Geometry of Preshape Space 3.5.3 Reparametrization Estimation by Using Dynamic Programming 3.5.4 Extension to Facial Surfaces Shape Analysis 3.6 The Dense Scalar Field (DSF) 3.7 Statistical Shape Analysis 3.7.1 Statistics on Manifolds: Karcher Mean 3.7.2 Learning Statistical Models in Shape Space 3.8 Applications of Statistical Shape Analysis 3.8.1 3D Face Restoration 3.8.2 Hierarchical Organization of Facial Shapes 3.9 The Iso-geodesic Stripes 3.9.1 Extraction of Facial Stripes 3.9.2 Computing Relationships between Facial Stripes 3.9.3 Face Representation and Matching using Iso-geodesic Stripes Exercises Glossary References 4 3D Morphable Models for Face Surface Analysis and Recognition Frank B. ter Haar and Remco Veltkamp 4.1 Introduction 4.2 Data Sets 4.3 Face Model Fitting 4.3.1 Distance Measure 4.3.2 Iterative Face Fitting 4.3.3 Coarse Fitting 4.3.4 Fine Fitting 4.3.5 Multiple Components 4.3.6 Results 4.4 Dynamic Model Expansion 4.4.1 Bootstrapping Algorithm 4.4.2 Results 4.5 Face Matching 4.5.1 Comparison 4.5.2 Results 4.6 Concluding Remarks Exercises References 5 Applications Stefano Berretti, Boulbaba Ben Amor, Hassen Drira, Mohamed Daoudi, Anuj Srivastava, Alberto del Bimbo and Pietro Pala 5.1 Introduction 5.2 3D Face Databases 5.3 3D Face Recognition 5.3.1 Challenges of 3D Face Recognition 5.3.2 3D Face Recognition: State of the Art 5.3.3 Partial Face Matching 5.3.4 Comparison of State-of-the-Art Methods 5.4 Facial Expression Analysis 5.4.1 3D Facial Expression Recognition: State of the Art 5.4.2 Semi-automatic 3D Facial Expression Recognition 5.4.3 Fully Automatic 3D Facial Expression Recognition 5.5 4D Facial Expression Recognition 5.5.1 The BU-4DFE Database 5.5.2 3D Shape Motion Analysis 5.5.3 Discussion and Comparative Evaluation Exercises Glossary References Index