[Preliminary study on the method of automatically determining facial landmarks based on three-dimensional face template]

Abstract

Objective: To explore the establishment of an efficient and automatic method to determine anatomical landmarks in three-dimensional (3D) facial data, and to evaluate the effectiveness of this method in determining landmarks. Methods: A total of 30 male patients with tooth defect or dentition defect (with good facial symmetry) who visited the Department of Prosthodontics, Peking University School and Hospital of Stomatology from June to August 2021 were selected, and these participants' age was between 18-45 years. 3D facial data of patients was collected and the size normalization and overlap alignment were performed based on the Procrustes analysis algorithm. A 3D face average model was built in Geomagic Studio 2013 software, and a 3D face template was built through parametric processing. MeshLab 2020 software was used to determine the serial number information of 32 facial anatomical landmarks (10 midline landmarks and 22 bilateral landmarks). Five male patients with no mandibular deviation and 5 with mild mandibular deviation were selected from the Department of Orthodontics or Oral and Maxillofacial Surgery, Peking University School and Hospital of Stomatology from June to August 2021. 3D facial data of patients was collected as test data. Based on the 3D face template and the serial number information of the facial anatomical landmarks, the coordinates of 32 facial anatomical landmarks on the test data were automatically determined with the help of the MeshMonk non-rigid registration algorithm program, as the data for the template method to determine the landmarks. The positions of 32 facial anatomical landmarks on the test data were manually determined by the same attending physician, and the coordinates of the landmarks were recorded as the data for determining landmarks by the expert method. Calculated the distance value of the coordinates of facial anatomical landmarks between the template method and the expert method, as the landmark localization error, and evaluated the effect of the template method in determining the landmarks. Results: For 5 patients with no mandibular deviation, the landmark localization error of all facial anatomical landmarks by template method was (1.65±1.19) mm, the landmark localization error of the midline facial anatomical landmarks was (1.19±0.45) mm, the landmark localization error of bilateral facial anatomical landmarks was (1.85±1.33) mm. For 5 patients with mild mandibular deviation, the landmark localization error of all facial anatomical landmarks by template method was (2.55±2.22) mm, the landmark localization error of the midline facial anatomical landmarks was (1.85±1.13) mm, the landmark localization error of bilateral facial anatomical landmarks was (2.87±2.45) mm. Conclusions: The automatic determination method of facial anatomical landmarks proposed in this study has certain feasibility, and the determination effect of midline facial anatomical landmarks is better than that of bilateral facial anatomical landmarks. The effect of determining facial anatomical landmarks in patients without mandibular deviation is better than that in patients with mild mandibular deviation.