Computer aided 3D morphometry of human faces is used in facial surgery, anthropology or perception research. Current software tools often require manual intervention during preparation of 3D data for morphological analysis. We aim to develop new approaches for automated assessment of intra- and inter-individual facial morphology for large-scale studies.

3D Mimik-Archiv

A central goal of our research is the establishment of a morphological database of faces covering a broad range of inter-individual factors like sex, ethnicity but also variation related to expressions. Together with our cooperation partners from psychology, we are investigating new experimental paradigms to capture a broad range of facial performances, posed and spontaneous expressions for the collection of the 3D Mimik-Archiv.

 

Posed facial expressions (surface and photographic texture) from the 3D Mimik-Archiv captured in our Studio Camera Facialis.

Statistical Models of Facial Shape and Texture

Statistical shape models (SSMs) are well-known tools for the assessment and analysis of the morphology of human anatomy. Within this project, we are developing new algorithms that allow to automatically generate SSMs from large-scale databases for the statistical examination of inter- and intraindividual facial morphology.

Statistical Model of Facial Expressions

 

To prevent a mixture of expression-characteristic motion patterns by a global PCA, we analyse the main modes of variation seperately per category. This results in an SSM with increased interpretability. Additionally, the preservation of characteristic motion patterns increases the accuracy of expression recognition.

Cultural Dimensions of Digital Facial Morphology

First work on the analysis of physiognomy is often dated back to the Greek philosophers Plato and Aristotle. Their work has been the foundation for the analysis of facial morphology and its critically discussed attribution to stereotypes and personal characteristics during history. Similarly, the analysis of affects and their manifestation in facial expressions has its roots in the work of the Greek philosophers. Through theories of affect and emotions, this association can still be identified in digital techniques for the coding of emotions from facial images today.

Together with our cooperation partners from the HU Cluster of Excellence and the Center for Literary and Cultural Research, we study these historical and cultural dimensions of current computer-aided methods. The aim is to identify the epistemic freight that is implicitly present in digital tools, such that it can be returned explicitly as part of our research.

Publications

2023
An Extended 3D Morphable Face Model with Applications in Experimental Psychology Doctoral thesis, Technische Universität Berlin, Stefan Zachow (Advisor), 2023 Martin Grewe BibTeX
Digital Facial Morphology
2022
The Open Virtual Mirror Framework for Enfacement Illusions - Enhancing the Sense of Agency With Avatars That Imitate Facial Expressions Behavior Research Methods, 2022 Carl Martin Grewe, Tuo Liu, Andrea Hildebrandt, Stefan Zachow BibTeX
DOI
Digital Facial Morphology
2021
Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces Frontiers in Virtual Reality, Vol.2, pp. 1-13, 2021 Carl Martin Grewe, Tuo Liu, Christoph Kahl, Hildebrandt Andrea, Stefan Zachow BibTeX
DOI
Digital Facial Morphology
2020
Symmetric or not? A holistic approach to the measurement of fluctuating asymmetry from facial photographs Personality and Individual Differences, Vol.166, pp. 1-12, 2020 Selina Weiss, Carl Martin Grewe, Sally Olderbak, Benjamin Goecke, Laura Kaltwasser, Andrea Hildebrandt BibTeX
DOI
Digital Facial Morphology
Symmetric or not? A holistic approach to the measurement of fluctuating asymmetry from facial photographs PsyArXiv, 2020 Selina Weiss, Carl Martin Grewe, Sally Olderbak, Benjamin Goecke, Laura Kaltwasser, Andrea Hildebrandt BibTeX
DOI
Digital Facial Morphology
2018
Spotting the Details: The Various Facets of Facial Expressions IEEE International Conference on Automatic Face and Gesture Recognition, pp. 286-293, 2018 (preprint available as ZIB-Report 18-06) Carl Martin Grewe, Gabriel le Roux, Sven-Kristofer Pilz, Stefan Zachow PDF (ZIB-Report)
BibTeX
DOI
Digital Facial Morphology
2017
Digital Image Archive. The Archiving and Coding of Emotions +ultra. Knowledge & Gestaltung, pp. 281-286, Nikola Doll, Horst Bredekamp, Wolfgang Schäffner (Eds.), Seemann Henschel, 2017 Carl Martin Grewe, Lisa Schreiber BibTeX
Digital Facial Morphology
Face to Face-Interface +ultra. Knowledge & Gestaltung, pp. 320-321, Nikola Doll, Horst Bredekamp, Wolfgang Schäffner (Eds.), Seemann Henschel, 2017 Carl Martin Grewe, Stefan Zachow BibTeX
Digital Facial Morphology
2016
Digitale Bildarchive. Archivierung und Codierung der Gefühle +ultra gestaltung schafft wissen, Seemann Henschel, pp. 285-290, 2016, ISBN: 978-3-86502-378-0 Carl Martin Grewe, Lisa Schreiber BibTeX
Digital Facial Morphology
Fully Automated and Highly Accurate Dense Correspondence for Facial Surfaces Computer Vision – ECCV 2016 Workshops, pp. 552-568, Vol.9914, 2016 Carl Martin Grewe, Stefan Zachow PDF
PDF
BibTeX
DOI
Digital Facial Morphology
Realtime Action Unit detection Bachelor's thesis, Freie Universität Berlin, Carl Martin Grewe (Advisor), 2016 Simón Auch BibTeX
Digital Facial Morphology
2015
3D Digital Morphology of Human Faces Anthropologie der Wahrnehmung. Marsilius-Sommerakademie Heidelberg, 14.-20. September, 2015 Carl Martin Grewe BibTeX
Digital Facial Morphology
Computational Planning in Facial Surgery Facial Plastic Surgery, 31(5), pp. 446-462, 2015 Stefan Zachow BibTeX
DOI
Digital Facial Morphology
Fast and Accurate Digital Morphometry of Facial Expressions Facial Plastic Surgery, 31(05), pp. 431-438, 2015 Carl Martin Grewe, Lisa Schreiber, Stefan Zachow BibTeX
DOI
Digital Facial Morphology
2013
Landmark-based Statistical Shape Analysis Auxology - Studying Human Growth and Development url, pp. 199-201, Michael Hermanussen (Ed.), Schweizerbart Verlag, Stuttgart, 2013 Carl Martin Grewe, Hans Lamecker, Stefan Zachow BibTeX
Digital Facial Morphology
2011
Digital morphometry: The Potential of Statistical Shape Models Anthropologischer Anzeiger. Journal of Biological and Clinical Anthropology, pp. 506-506, 2011 Carl Martin Grewe, Hans Lamecker, Stefan Zachow BibTeX
Digital Facial Morphology
2008
Variational and statistical shape modeling for 3D geometry reconstruction Doctoral thesis, Freie Universität Berlin, Peter Deuflhard, Martin Rumpf (Advisors), 2008 Hans Lamecker BibTeX
Digital Facial Morphology