Video based hand gesture recognition dataset using thermal camera

Simen Birkeland; Lin Julie Fjeldvik; Nadia Noori; Sreenivasa Reddy Yeduri; Linga Reddy Cenkeramaddi

doi:10.1016/j.dib.2024.110299

Video based hand gesture recognition dataset using thermal camera

Data Brief. 2024 Mar 6:54:110299. doi: 10.1016/j.dib.2024.110299. eCollection 2024 Jun.

Authors

Simen Birkeland¹, Lin Julie Fjeldvik¹, Nadia Noori¹, Sreenivasa Reddy Yeduri¹, Linga Reddy Cenkeramaddi¹

Affiliation

¹ ACPS Group, Department of Information and Communication Technology, University of Agder, 4879, Norway.

Abstract

The dataset includes thermal videos of various hand gestures captured by the FLIR Lepton Thermal Camera. A large dataset is created to accurately classify hand gestures captured from eleven different individuals. The dataset consists of 9 classes corresponding to various hand gestures from different people collected at different time instances with complex backgrounds. This data includes flat/leftward, flat/rightward, flat/contract, spread/ leftward, spread/rightward, spread/contract, V-shape/leftward, V-shape/rightward, and V-shape/contract. There are 110 videos in the dataset for each gesture and a total of 990 videos corresponding to 9 gestures. Each video has data of three different ( $15 / 10 / 5$ ) frame lengths.

Keywords: Jetson nano; Machine learning; Neural network; Thermal image; Video hand gestures.