Institutions | About Us | Help | Gaeilge
rian logo

Go Back
Multimodal sensor fusion for low-power wearable human motion tracking systems in sports applications
Wilk, Mariusz P.; Walsh, Michael; O'Flynn, Brendan
This paper presents a prototype human motion tracking system for wearable sports applications. It can be particularly applicable for tracking human motion during executing certain strength training exercises, such as the barbell squat, where an inappropriate technique could result in an injury. The key novelty of the proposed system is twofold. Firstly, it is an inside-out, multimodal, motion tracker that incorporates two complementary sensor modalities, i.e. a camera and an inertial motion sensor, as well as two externally-mounted points of reference. Secondly, it incorporates a novel multimodal sensor fusion algorithm which uses the complementary nature of vision and inertial sensor modalities to perform a computationally efficient 3-Dimensional (3-D) pose detection of the wearable device. The 3-D pose is determined by fusing information about the two external reference points captured by the camera together with the orientation angles captured by the inertial motion sensor. The accuracy of the prototype was experimentally validated in laboratory conditions. The main findings are as follows. The Root Mean Square Error (RMSE) in 3-D position calculation was 36.7 mm and 13.6 mm in the static and mobile cases, respectively. Whereas the static case was aimed at determining the system’s performance at all 3-D poses within the work envelope, the mobile case was used to determine the error in tracking human motion that is involved in the barbell squat, i.e. a mainly repeated vertical motion pattern.
Keyword(s): Tracking; Cameras; Multimodal sensors; Injuries; Sensor fusion; Vision sensors; Inertial Motion Sensor; Inside-Out Tracking; Pose Detection; Monocular Camera; Multimodal; 3-D
Publication Date:
Type: Journal article
Peer-Reviewed: Yes
Language(s): English
Institution: University College Cork
Funder(s): Science Foundation Ireland
Citation(s): Wilk, M. P., Walsh, M. and O’Flynn, B. (2020) 'Multimodal Sensor Fusion for Low-Power Wearable Human Motion Tracking Systems in Sports Applications', IEEE Sensors Journal, doi: 10.1109/JSEN.2020.3030779
Publisher(s): Institute of Electrical and Electronics Engineers (IEEE)
File Format(s): application/pdf
Related Link(s):
First Indexed: 2020-10-20 06:30:40 Last Updated: 2020-10-20 06:30:40