Key Landmarks Detection of Cleft Lip-Repaired Partially Occluded Facial Images for Aesthetics Outcome Assessment

Paul Bakaki, Bruce Richard, Ella Pereira, Aristides Tagalakis, Andy Ness, Ardhendu Behera, Yonghuai Liu*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding (ISBN)peer-review

49 Downloads (Pure)

Abstract

This paper proposes a novel method for the detection of the symmetrical axis of the cropped face required for the aesthetic outcome estimation from the facial images of patients after their cleft treatment. It firstly applies the Gaussian filter to smooth the images in order to compress noise on the subsequent tasks, then the bilateral semantic segmentation network is applied to segment the facial components out and each region is assigned a distinct colour, thirdly the Canny edge detector is applied to detect the facial feature points and all the contours are further detected and classified into three thirds according to their height. Fourthly, the centres of mass of detected feature points on the contours and the average of all these centres are used to estimate four potential symmetrical axes of the face, the one with minimum Manhattan distance from all the detected feature points is finally selected as the optimal one and used to estimate the aesthetic numerical score through the shape analysis in structural similarity measure. The experimental results based on a publicly accessible dataset shows that it performs well and better than one existing method.

Original languageEnglish
Title of host publicationImage Analysis and Processing – ICIAP 2022 - 21st International Conference, 2022, Proceedings
EditorsStan Sclaroff, Cosimo Distante, Marco Leo, Giovanni M. Farinella, Federico Tombari
PublisherSpringer Science and Business Media Deutschland GmbH
Pages718-729
Number of pages12
Volume13232
ISBN (Print)9783031064296
DOIs
Publication statusPublished - 17 May 2022
Event21st International Conference on Image Analysis and Processing, ICIAP 2022 - Lecce, Italy
Duration: 23 May 202227 May 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13232 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Image Analysis and Processing, ICIAP 2022
Country/TerritoryItaly
CityLecce
Period23/05/2227/05/22

Keywords

  • Aesthetic outcome estimation
  • Cleft
  • Facial image
  • Shape analysis
  • Symmetrical axis

Research Centres

  • Centre for Intelligent Visual Computing Research
  • Data and Complex Systems Research Centre

Fingerprint

Dive into the research topics of 'Key Landmarks Detection of Cleft Lip-Repaired Partially Occluded Facial Images for Aesthetics Outcome Assessment'. Together they form a unique fingerprint.

Cite this