Human action recognition using fusion of depth and inertial sensors

Fuad, Zain and Ünel, Mustafa (2018) Human action recognition using fusion of depth and inertial sensors. In: 15th International Conference on Image Analysis and Recognition, ICIAR 2018, Povoa de Varzim, Portugal

[thumbnail of _469267_1_En_42_Chapter_Author.pdf] PDF

Download (868kB)


In this paper we present a human action recognition system that utilizes the fusion of depth and inertial sensor measurements. Robust depth and inertial signal features, that are subject-invariant, are used to train independent Neural Networks, and later decision level fusion is employed using a probabilistic framework in the form of Logarithmic Opinion Pool. The system is evaluated using UTD-Multimodal Human Action Dataset, and we achieve 95% accuracy in 8-fold cross-validation, which is not only higher than using each sensor separately, but is also better than the best accuracy obtained on the mentioned dataset by 3.5%.
Item Type: Papers in Conference Proceedings
Uncontrolled Keywords: Depth camera; Human action recognition; Inertial sensor; Logarithmic opinion pool; Neural Network; Sensor fusion
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics > TK7885-7895 Computer engineering. Computer hardware
T Technology > TJ Mechanical engineering and machinery > TJ163.12 Mechatronics
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Mechatronics
Faculty of Engineering and Natural Sciences
Depositing User: Mustafa Ünel
Date Deposited: 12 Aug 2018 21:08
Last Modified: 29 May 2023 15:34

Actions (login required)

View Item
View Item