Skip to main navigation Skip to search Skip to main content

Occlusion-Aware Face Retrieval: Identity Restoration through Generative Inpainting

  • Enis Teper*
  • , Selçuk Açlkalln
  • , Yunus Emre Gündoǧmuş
  • , Yusuf Hüseyin Şahin
  • *Corresponding author for this work
  • Hepsiburada
  • Istanbul Technical University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Occlusions remain a major obstacle for reliable face recognition and person re-identification, as they obscure critical identity features and distort embedding representations. In this work, we present a unified and reproducible pipeline for evaluating both the impact of occlusion and the effectiveness of generative inpainting in restoring identity-preserving facial information. Using the LFW dataset, we generate realistic occlusions via semantically guided masks with Stable Diffusion, and subsequently apply state-of-the-art inpainting methods for occlusion removal. Reconstruction quality is assessed using a comprehensive set of structural and perceptual metrics, while identity preservation is evaluated through retrieval experiments across diverse embedding architectures representing both supervised and self-supervised learning paradigms. Experimental results demonstrate that inpainting can significantly mitigate the adverse effects of occlusion on retrieval performance. Furthermore, our findings reveal that conventional perceptual metrics do not fully capture identity consistency, highlighting the need for embedding-aware evaluation. This study offers a complete benchmarking framework and cross-model analysis to advance research on occlusion-robust face recognition.

Original languageEnglish
Title of host publicationAICCC 2025 - 2025 8th Artificial Intelligence and Cloud Computing Conference
PublisherAssociation for Computing Machinery, Inc
Pages355-362
Number of pages8
ISBN (Electronic)9798400718892
DOIs
Publication statusPublished - 4 May 2026
Event2025 8th Artificial Intelligence and Cloud Computing Conference, AICCC 2025 - Tokyo, Japan
Duration: 20 Dec 202522 Dec 2025

Publication series

NameAICCC 2025 - 2025 8th Artificial Intelligence and Cloud Computing Conference

Conference

Conference2025 8th Artificial Intelligence and Cloud Computing Conference, AICCC 2025
Country/TerritoryJapan
CityTokyo
Period20/12/2522/12/25

Bibliographical note

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

Keywords

  • CLIP
  • Face Recognition
  • Image Retrieval
  • Inpainting
  • Occlusion
  • Person Re-identification
  • Stable Diffusion

Fingerprint

Dive into the research topics of 'Occlusion-Aware Face Retrieval: Identity Restoration through Generative Inpainting'. Together they form a unique fingerprint.

Cite this