Jurnal Ilmiah Teknik Elektro Komputer dan Informatika (JITEKI)
Vol 9, No 2 (2023): June

Pilates Pose Classification Using MediaPipe and Convolutional Neural Networks with Transfer Learning

Kenneth Angelo Tanjaya (Tenik Informatika, Universitas Surabaya, Jalan Raya Kalirungkut, Surabaya 60293, Indonesia)
Mohammad Farid Naufal (Tenik Informatika, Universitas Surabaya, Jalan Raya Kalirungkut, Surabaya 60293, Indonesia)
Heru Arwoko (Tenik Informatika, Universitas Surabaya, Jalan Raya Kalirungkut, Surabaya 60293, Indonesia)



Article Info

Publish Date
15 Apr 2023

Abstract

A sedentary lifestyle can lead to heart disease, cancer, and type 2 diabetes. An anaerobic exercise called pilates can address these problems. Although pilates training can provide health benefits, the heavy load of pilates poses may cause severe muscle injury if not done properly. Surveys have found that many teenagers are unaware of the movements in pilates poses. Therefore, a system is needed to help users classify pilates poses accurately. MediaPipe is a system that accurately extracts the real time human body skeleton. Convolutional Neural Network (CNN) with transfer learning is an accurate method for image classification. There have been several studies investigated pilates poses classification. However, there is still no research applies the MediaPipe as a skeleton feature extractor and CNN with a transfer learning to classify pilates poses. In addition, previous research still does not implement the pilates poses classification in real-time. Based on this problem, this study creates a system using MediaPipe as a feature extractor and CNN with transfer learning as a real-time pilates poses classifier. This system runs on a mobile device and gets information from a camera sensor. The results from MediaPipe then be classified by pre-trained CNN architectures with transfer learning: MobileNetV2, Xception, and ResNet50. The best model was obtained by MobileNetV2, which had an f1 score of 98%. Ten people who didn't know much about Pilates also tested the system. They all agreed that the app could accurately identify Pilates poses, make people more interested in Pilates, and help them learn more about Pilates.

Copyrights © 2023






Journal Info

Abbrev

JITEKI

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

JITEKI (Jurnal Ilmiah Teknik Elektro Komputer dan Informatika) is a peer-reviewed, scientific journal published by Universitas Ahmad Dahlan (UAD) in collaboration with Institute of Advanced Engineering and Science (IAES). The aim of this journal scope is 1) Control and Automation, 2) Electrical ...