Apex frame spotting using convolutional neural networks with continuous labeling

Min, Koo Sie and Zulkifley, Mohd Asyraf and Yanıkoğlu, Berrin and Kamari, Nor Azwan Mohamed (2022) Apex frame spotting using convolutional neural networks with continuous labeling. In: 11th International Conference on Robotics, Vision, Signal Processing and Power Applications, RoViSP 2021, Virtual, Online

Full text not available from this repository. (Request a copy)


Apex frame is the frame containing the highest intensity changes of facial movements in a sequence of video. It plays a crucial role in the analysis of micro-expressions, which generally have minute facial movements. This frame is hard to be identified that requires a laborious and time-consuming effort from highly skilled specialists. Therefore, a convolutional neural networks-based technique is proposed to automate apex frame detection using a novel continuous labeling scheme. The network is trained using ascending and descending labels according to the linear and exponential functions, pivoted on the ground truth apex frame. Two datasets, CASME II and SAMM databases are used to verify the proposed algorithm, where the apex frame is determined according to the maximum label intensity and a sliding window of the maximum label intensity. The results show that a linear continuous label with the sliding window approach produced the lowest average error of 14.37 frames.
Item Type: Papers in Conference Proceedings
Uncontrolled Keywords: Apex frame spotting; Convolutional neural networks; Micro-expression
Divisions: Faculty of Engineering and Natural Sciences
Depositing User: Berrin Yanıkoğlu
Date Deposited: 25 Aug 2022 08:55
Last Modified: 25 Aug 2022 08:55
URI: https://research.sabanciuniv.edu/id/eprint/44034

Actions (login required)

View Item
View Item