Multi-label networks for face attributes classification

Ali Ahmed, Sara Atito and Yanıkoğlu, Berrin (2018) Multi-label networks for face attributes classification. In: IEEE International Conference on Multimedia and Expo (ICME 2018) Workshop, San Diego, CA

[thumbnail of icme-final-paper.pdf] PDF

Download (1MB)


Face attributes classification is drawing attention as a research topic with applications in multiple domains, such as video surveillance and social media analysis. In most attribute classification systems in literature, independent classifiers are trained separately for each attribute. In this work, we propose to train attributes in groups based on their localization (head, eyes, nose, cheek, mouth, shoulder, and general areas) in a multi-task learning scenario to speed up the training process and to prevent overfitting. We have evaluated the idea of using the location knowledge for a particular attribute group to speed up the network training. Attention is drawn to the area of interest by blurring training images outside the region of interest, fine-tuning the system and freezing the earlier layers before continuing training with original images. Several data augmentation techniques are also performed to reduce over-fitting. Our approach outperforms the state-of-the-art of the attributes on the public LFWA dataset, with an average improvement of almost 0.7% points. The accuracy ranges from 78% (detecting oval face or shadow on the face) to 97.4% (detecting blond hair) across the attributes.
Item Type: Papers in Conference Proceedings
Uncontrolled Keywords: Data Augmentation; Deep Learning; Face Attributes; Multi-Label classification; Transfer Learning
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: Berrin Yanıkoğlu
Date Deposited: 06 Sep 2018 16:23
Last Modified: 08 Jun 2023 13:59

Actions (login required)

View Item
View Item