Interactive person re-identification in TV series

Mika Fischer*, Hazim Kemal Ekenel, Rainer Stiefelhagen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Citations (Scopus)

Abstract

In this paper, we present a system for person re-identification in TV series. In the context of video retrieval, person re-identification refers to the task where a user clicks on a person in a video frame and the system then finds other occurrences of the same person in the same or different videos. The main characteristic of this scenario is that no previously collected training data is available, so no person-specific models can be trained in advance. Additionally, the query data is limited to the image that the user clicks on. These conditions pose a great challenge to the re-identification system, which has to find the same person in other shots despite large variations in the person's appearance. In the study, facial appearance is used as the reidentification cue. In order to increase the amount of available face data, the proposed system employs a face tracker that can track faces up to full profile views. A fast and robust face recognition algorithm is used to find matching faces. If the match result is highly confident, our system adds the matching face track to the query set. This approach help to increase the variation in the query set, making it possible to retrieve results with different poses, illumination conditions, etc. Furthermore, if the user is not satisfied with the number of returned results, the system can present a small number of candidate face images and lets the user confirm the ones that belong to the queried person. The system is extensively evaluated on two episodes of the TV series Coupling, showing very promising results.

Original languageEnglish
Title of host publicationCBMI 2010 - 8th International Workshop on Content-Based Multimedia Indexing
Pages219-224
Number of pages6
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event8th International Workshop on Content-Based Multimedia Indexing, CBMI 2010 - Grenoble, France
Duration: 23 Jun 201025 Jun 2010

Publication series

NameProceedings - International Workshop on Content-Based Multimedia Indexing
ISSN (Print)1949-3991

Conference

Conference8th International Workshop on Content-Based Multimedia Indexing, CBMI 2010
Country/TerritoryFrance
CityGrenoble
Period23/06/1025/06/10

Fingerprint

Dive into the research topics of 'Interactive person re-identification in TV series'. Together they form a unique fingerprint.

Cite this