Lip segmentation using adaptive color space training

Warning The system is temporarily closed to updates for reporting purpose.

Özgür, Erol and Yılmaz, Mustafa Berkay and Karabalkan, Harun and Erdoğan, Hakan and Ünel, Mustafa (2008) Lip segmentation using adaptive color space training. In: Auditory Visual Speech Processing, Moreton Island

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader


In audio-visual speech recognition (AVSR), it is beneficial to use lip boundary information in addition to texture-dependent features. In this paper, we propose an automatic lip segmentation method that can be used in AVSR systems. The algorithm consists of the following steps: face detection, lip corners extraction, adaptive color space training for lip and non-lip regions using Gaussian mixture models (GMMs), and curve evolution using level-set formulation based on region and image gradients fields. Region-based fields are obtained using adapted GMM likelihoods. We have tested the proposed algorithm on a database (SU-TAV) of 100 facial images and obtained objective performance results by comparing automatic lip segmentations with hand-marked ground truth segmentations. Experimental results are promising and much work has to be done to improve the robustness of the proposed method.

Item Type:Papers in Conference Proceedings
Uncontrolled Keywords:Lip segmentation, color spaces, GMM, levelsets
Subjects:T Technology > TK Electrical engineering. Electronics Nuclear engineering
ID Code:10287
Deposited By:Hakan Erdoğan
Deposited On:08 Nov 2008 15:43
Last Modified:22 Jul 2019 09:27

Repository Staff Only: item control page