Semi-supervised identification of rarely appearing persons in video by correcting weak labels

Loading...
Thumbnail Image
Date
2016
Volume
Issue
Journal Title
Title
Series Titel
Publisher
New York City : Association for Computing Machinery
Abstract

Some recent approaches for character identification in movies and TV broadcasts are realized in a semi-supervised manner by assigning transcripts and/or subtitles to the speakers. However, the labels obtained in this way achieve only an accuracy of 80% - 90% and the number of training examples for the different actors is unevenly distributed. In this paper, we propose a novel approach for person identification in video by correcting and extending the training data with reliable predictions to reduce the number of annotation errors. Furthermore, the intra-class diversity of rarely speaking characters is enhanced. To address the imbalance of training data per person, we suggest two complementary prediction scores. These scores are also used to recognize whether or not a face track belongs to a (supporting) character whose identity does not appear in the transcript etc. Experimental results demonstrate the feasibility of the proposed approach, outperforming the current state of the art.

Description
Keywords
Face identification in video, semi-supervised learning
Citation
Müller, E., Otto, C., & Ewerth, R. (2016). Semi-supervised identification of rarely appearing persons in video by correcting weak labels. New York City : Association for Computing Machinery. https://doi.org//10.1145/2911996.2912073
License
CC BY 4.0 Unported