Skip to main navigation Skip to search Skip to main content

Employing Vision-Language Models for Face Image Quality Assessment

  • Istanbul Technical University
  • University of Ljubljana
  • New York University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Face Image Quality Assessment (FIQA) is a crucial control step in biometric pipelines. It ensures only reliable samples are processed to maintain system accuracy. State-of-the-art FIQA methods achieve high utility but typically operate as 'black boxes.' They produce scalar scores without humaninterpretable justifications. This lack of transparency limits their effectiveness in human-in-the-loop scenarios, such as automated border control, where actionable feedback is essential. In this paper, we investigate the potential of off-the-shelf VisionLanguage Models (VLMs) to bridge this gap by performing FIQA in a zero-shot setting. We present a comprehensive evaluation framework for assessing VLM performance. This involves benchmarking traditional FIQA methods through error-versusreject curves. Additionally, using a diverse set of datasets, ranging from surveillance-oriented to synthetically generated, we analyzed their interpretability, consistency, and robustness to prompt changes. Our results show biometric utility performance depends significantly on architecture, not merely on parameter count. Most VLMs' outputs align with those of traditional methods. We also find that VLM ranking performance and the generated scores may vary across prompts. Our synthetic ablation study shows that while increasing the parameter count can improve internal consistency, it yields worse degradation-detection performance than smaller models. These findings suggest that zero-shot FIQA score estimation using VLMs is promising and could effectively complement conventional FIQA pipelines as an interpretability module. The codes are available at github.com/ThEnded32/VLM4FIQA.git.

Original languageEnglish
Title of host publicationFG 2026 - 20th IEEE International Conference on Automatic Face and Gesture Recognition
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331572310
DOIs
Publication statusPublished - 2026
Event20th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2026 - Kyoto, Japan
Duration: 25 May 202629 May 2026

Publication series

NameFG 2026 - 20th IEEE International Conference on Automatic Face and Gesture Recognition

Conference

Conference20th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2026
Country/TerritoryJapan
CityKyoto
Period25/05/2629/05/26

Bibliographical note

Publisher Copyright:
© 2026 IEEE.

Fingerprint

Dive into the research topics of 'Employing Vision-Language Models for Face Image Quality Assessment'. Together they form a unique fingerprint.

Cite this