Multi-modal person recognition for vehicular applications

Erdoğan, Hakan and Erçil, Aytül and Ekenel, Hazım Kemal and Bilgin, Seyfettin Yasin and Eden, İbrahim and Kirişci, Meltem and Abut, Hüseyin (2005) Multi-modal person recognition for vehicular applications. Lecture Notes in Computer Science, 3541 . pp. 366-375. ISSN 0302-9743

[thumbnail of 3011800001115.pdf] PDF
Restricted to Repository staff only

Download (210kB) | Request a copy


In this paper, we present biometric person recognition experiments in a real-world car environment using speech, face, and driving signals. We have performed experiments on a subset of the in-car corpus collected at the Nagoya University, Japan. We have used Mel-frequency cepstral coefficients (MFCC) for speaker recognition. For face recognition, we have reduced the feature dimension of each face image through principal component analysis (PCA). As for modeling the driving behavior, we have employed features based on the pressure readings of acceleration and brake pedals and their time-derivatives. For each modality, we use a Gaussian mixture model (GMM) to model each person’s biometric data for classification. GMM is the most appropriate tool for audio and driving signals. For face, even though a nearest-neighbor-classifier is the preferred choice, we have experimented with a single mixture GMM as well. We use background models for each modality and also normalize each modality score using an appropriate sigmoid function. At the end, all modality scores are combined using a weighted sum rule. The weights are optimized using held-out data. Depending on the ultimate application, we consider three different recognition scenarios: verification, closed-set identification, and open-set identification. We show that each modality has a positive effect on improving the recognition performance.
Item Type: Article
Subjects: Q Science > QA Mathematics > QA075 Electronic computers. Computer science
Divisions: Faculty of Engineering and Natural Sciences
Depositing User: Aytül Erçil
Date Deposited: 15 Oct 2005 03:00
Last Modified: 26 Apr 2022 08:11

Actions (login required)

View Item
View Item