Lip segmentation using adaptive color space training

Özgür, Erol and Yılmaz, Mustafa Berkay and Karabalkan, Harun and Erdoğan, Hakan and Ünel, Mustafa (2008) Lip segmentation using adaptive color space training. In: Auditory Visual Speech Processing, Moreton Island

[thumbnail of ozgur08lsu.pdf] PDF

Download (350kB)


In audio-visual speech recognition (AVSR), it is beneficial to use lip boundary information in addition to texture-dependent features. In this paper, we propose an automatic lip segmentation method that can be used in AVSR systems. The algorithm consists of the following steps: face detection, lip corners extraction, adaptive color space training for lip and non-lip regions using Gaussian mixture models (GMMs), and curve evolution using level-set formulation based on region and image gradients fields. Region-based fields are obtained using adapted GMM likelihoods. We have tested the proposed algorithm on a database (SU-TAV) of 100 facial images and obtained objective performance results by comparing automatic lip segmentations with hand-marked ground truth segmentations. Experimental results are promising and much work has to be done to improve the robustness of the proposed method.
Item Type: Papers in Conference Proceedings
Uncontrolled Keywords: Lip segmentation, color spaces, GMM, levelsets
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Mechatronics
Faculty of Engineering and Natural Sciences > Academic programs > Electronics
Depositing User: Hakan Erdoğan
Date Deposited: 08 Nov 2008 15:43
Last Modified: 26 Apr 2022 08:47

Actions (login required)

View Item
View Item