Multi-modal person recognition for vehicular applications

Warning The system is temporarily closed to updates for reporting purpose.

Erdoğan, Hakan and Erçil, Aytül and Ekenel, Hazım Kemal and Bilgin, Seyfettin Yasin and Eden, İbrahim and Kirişci, Meltem and Abut, Hüseyin (2005) Multi-modal person recognition for vehicular applications. Lecture Notes in Computer Science, 3541 . pp. 366-375.

[img]PDF - Repository staff only - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader

Official URL: http://dx.doi.org/10.1007/11494683_36


In this paper, we present biometric person recognition experiments in a real-world car environment using speech, face, and driving signals. We have performed experiments on a subset of the in-car corpus collected at the Nagoya University, Japan. We have used Mel-frequency cepstral coefficients (MFCC) for speaker recognition. For face recognition, we have reduced the feature dimension of each face image through principal component analysis (PCA). As for modeling the driving behavior, we have employed features based on the pressure readings of acceleration and brake pedals and their time-derivatives. For each modality, we use a Gaussian mixture model (GMM) to model each person’s biometric data for classification. GMM is the most appropriate tool for audio and driving signals. For face, even though a nearest-neighbor-classifier is the preferred choice, we have experimented with a single mixture GMM as well. We use background models for each modality and also normalize each modality score using an appropriate sigmoid function. At the end, all modality scores are combined using a weighted sum rule. The weights are optimized using held-out data. Depending on the ultimate application, we consider three different recognition scenarios: verification, closed-set identification, and open-set identification. We show that each modality has a positive effect on improving the recognition performance.

Item Type:Article
Subjects:Q Science > QA Mathematics > QA075 Electronic computers. Computer science
ID Code:611
Deposited By:Aytül Erçil
Deposited On:15 Oct 2005 03:00
Last Modified:28 Feb 2010 20:41

Repository Staff Only: item control page