Matching 3D Facial Shape to Demographic Properties by Geometric Metric Learning: A Part-Based Approach

Soha Sadat Mahdi, Nele Nauwelaers*, Philip Joris, Giorgos Bouritsas, Shunwang Gong, Susan Walsh, Mark D. Shriver, Michael Bronstein, Peter Claes

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

Face recognition is a widely accepted biometric identifier, as the face contains a lot of information about the identity of a person. The goal of this study is to match the 3D face of an individual to a set of demographic properties (sex, age, BMI, and genomic background) that are extracted from unidentified genetic material. We introduce a triplet loss metric learner that compresses facial shape into a lower dimensional embedding while preserving information about the property of interest. The metric learner is trained for multiple facial segments to allow a global-to-local part-based analysis of the face. To learn directly from 3D mesh data, spiral convolutions are used along with a novel mesh-sampling scheme, which retains uniformly sampled points at different resolutions. The capacity of the model for establishing identity from facial shape against a list of probe demographics is evaluated by enrolling the embeddings for all properties into a support vector machine classifier or regressor and then combining them using a naive Bayes score fuser. Results obtained by a 10-fold cross-validation for biometric verification and identification show that part-based learning significantly improves the systems performance for both encoding with our geometric metric learner or with principal component analysis.

Original languageEnglish
Pages (from-to)163-172
Number of pages10
JournalIEEE Transactions on Biometrics, Behavior, and Identity Science
Volume4
Issue number2
DOIs
StatePublished - 1 Apr 2022
Externally publishedYes

Funding

FundersFunder number
Research Fund KU LeuvenC14/15/081, BOF-C1
National Institutes of Health1-RO1-DE027023
National Institute of Justice2014-DN-BX-K031, 2018-DU-BX-0219
Fonds Wetenschappelijk OnderzoekG078518N

    Keywords

    • Deep metric learning
    • face to DNA
    • geometric deep learning
    • multi biometrics
    • soft biometrics

    Fingerprint

    Dive into the research topics of 'Matching 3D Facial Shape to Demographic Properties by Geometric Metric Learning: A Part-Based Approach'. Together they form a unique fingerprint.

    Cite this