Three-Dimensional Modeling of Faces Utilizing Robust Characteristics

Three-Dimensional Modeling of Faces Utilizing Robust Characteristics

Authors

DOI:

https://doi.org/10.5433/1679-0375.2024.v45.48505

Keywords:

three-dimensional modeling, human faces, landmarks, points, computer graphics

Abstract

The modeling of human faces is an integral part of a variety of computer applications, from animation and entertainment programs to security and facial recognition apps. This paper presents an alternative method that, given a photo as input, extracts a set of landmarks, anatomical points extracted from a human's face, modifying a triangular polygonal mesh using principles of computer graphics so that it resembles the face whose characteristics have been extracted without requiring additional input from the user. After the creation of the initial mesh, this method, implemented in Python for testing purposes, utilizes principles of three-dimensional mesh modeling such as the use of δ-coordinates to allow the user to perform controlled modifications in the mesh by moving the landmarks. The meshes generated by this method maintain the format and colors of the original face, extracted from the photo offered as input, with tests showing the resistance of the mesh to deformation, as well as corroborating that there is little to no effect on the speed of how modifications are performed based on the degree of the vertex or by how much it is moved.

Author Biographies

Pedro Regattieri Rocha, Universidade de São Paulo - USP/ICMS

PhD, ICMC, USP, São Carlos, São Paulo, Brazil. pedro.regattieri.rocha@usp.br

João do Espírito Santo Batista Neto, Universidade de São Paulo

Professor, ICMC, USP, São Carlos, São Paulo, Brazil. jbatista@icmc.usp.br

References

Afzal, H. M. R., Luo, S., Afzal, M. K., Chaudhary, G., Khari, M., & Kumar, S. A. P. (2020). 3D Face Reconstruction From Single 2D Image Using Distinctive Features. IEEE Access, 8, 180681–180689.

A-Nasser, A., Mohammad, M., & Mohamed, A. (2009). 3D Face Mesh Modeling for 3D Face Recognition. In M. I. C. Murguía. (Ed.), State of the Art in Face Recognition. I-Tech Education and Publishing.

Botsch, M., Pauly, M., Kobbelt, L., Alliez, P., Lévy, B., Bischoff, S., & Rössl, C. (2007). Geometric modeling based on polygonal meshes. In S. McMains, & P.-P. Sloan, SIGGRAPH ’07: ACM SIGGRAPH 2007 courses [Conference]. SIGGRAPH07: Special Interest Group on Computer Graphics and Interactive Techniques Conference, San Diego, California.

Google. (2019). MediaPipe Face Mesh. https://developers.google.com/mediapipe/

Kittler, J., Huber, P., Feng, Z., Hu, G., & Christmas, W. (2016). 3D Morphable Face Models and Their Applications. In F. J. Perales & J. Kittler (Eds.), Lecture Notes in Computer Science (LNCS) vol.9756: 9th International Conference, AMDO 2016 [Proceedings]. IX Conference on Articulated Motion and Deformable Objects, Palma, Mallorca.

Lipman, Y., Sorkine, O., Cohen-Or, D., Levin, D., Rossi, C., & Seidel, H. (2004). Differential coordinates for interactive mesh editing. Proceedings Shape Modeling Applications [Proceedings]. Shape Modeling Applications, Genova, Italy.

Richmond, S., Howe, L. J., Lewis, S., Stergiakouli, E., & Zhurov, A. (2018). Facial Genetics: A Brief Overview. Frontiers in Genetics, 9, 1–21.

Soares, I. P. (2007). Movimento de malhas e remalhamento de malhas superficiais. [Tese de doutorado, Universidade de São Paulo]. Biblioteca Digital.

Sorkine, O. (2006). Differential Representations for Mesh Processing. Computer Graphics Forum, 25, 789–807.

Xian-Feng, H., Jesse, S. J., Ming-Jie, W., Wei, J., Lei, G., & Liping, X. (2017). A review of algorithms for filtering the 3D point cloud. Signal Processing: Image Communication, 57, 103–112.

Zhang, S., & Xiao, N. (2021). Detailed 3D Human Body Reconstruction From a Single Image Based on Mesh Deformation. IEEE Access, 9, 8595–8603.

Downloads

Published

2024-08-06

How to Cite

Regattieri Rocha, P., & do Espírito Santo Batista Neto, J. (2024). Three-Dimensional Modeling of Faces Utilizing Robust Characteristics. Semina: Ciências Exatas E Tecnológicas, 45, e48505. https://doi.org/10.5433/1679-0375.2024.v45.48505

Issue

Section

Computer Science

Similar Articles

You may also start an advanced similarity search for this article.

Loading...