Landmark-based homologous multi-point warping approach to 3D facial recognition using multiple datasets

PeerJ Comput Sci. 2020 Jan 16:6:e249. doi: 10.7717/peerj-cs.249. eCollection 2020.

Abstract

Over the years, neuroscientists and psychophysicists have been asking whether data acquisition for facial analysis should be performed holistically or with local feature analysis. This has led to various advanced methods of face recognition being proposed, and especially techniques using facial landmarks. The current facial landmark methods in 3D involve a mathematically complex and time-consuming workflow involving semi-landmark sliding tasks. This paper proposes a homologous multi-point warping for 3D facial landmarking, which is verified experimentally on each of the target objects in a given dataset using 500 landmarks (16 anatomical fixed points and 484 sliding semi-landmarks). This is achieved by building a template mesh as a reference object and applying this template to each of the targets in three datasets using an artificial deformation approach. The semi-landmarks are subjected to sliding along tangents to the curves or surfaces until the bending energy between a template and a target form is minimal. The results indicate that our method can be used to investigate shape variation for multiple datasets when implemented on three databases (Stirling, FRGC and Bosphorus).

Keywords: 3D facial landmark; 3D morphology; Homologous facial points; Landmark algorithm; Multiple datasets; TPS warping.

Grants and funding

This work was supported by Putra Geran UPM (No. 9538100) and Fundamental Research Grant Scheme (No. 5524959). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.