Personal Training with Tai Chi: Classifying Movement using Mediapipe Pose Estimation and LSTM
Pose Estimation and Machine Learning Classification Using LSTM
-
Vartin Suhandi
*
Pradita University, Tangerang,
Indonesia
- Handri Santoso Pradita University, Tangerang, Indonesia (*) Corresponding Author
Abstract
This research aims to tackle challenges in the practice of Tai Chi Bafa Wubu (BWTC), where limited access to trained instructors and daily schedules hinder training consistency. The proposed approach combines Human Pose Estimation technology using Mediapipe with Long Short-Term Memory (LSTM) models to classify BWTC movements. This method utilizes video datasets collected from the internet and augmented to train LSTM models, focusing on An, Ji, and Zhou movements. Experimental results show that the model can predict movements with high accuracy in training and direct user trials. The development of these techniques facilitates more effective self-training in Tai Chi, leveraging advanced AI technology to improve movement supervision and user movement interpretation accuracy. This study not only offers a practical solution to enhance Tai Chi training efficiency and accessibility but also explores the potential application of pose estimation technology and machine learning in broader sports movement monitoring and evaluation. It is expected that this research will make a significant contribution to health and fitness by enabling individuals to independently practice Tai Chi with technological guidance, promoting better mental and physical health among the general public.
Downloads
References
Y. Du, P. Roberts, and W. Liu, “Facilitators and Barriers of Tai Chi Practice in Community-Dwelling Older Adults: Qualitative Study,” Asian Pacific Island Nursing Journal, vol. 7, 2023, doi: 10.2196/42195.
S. Lyu et al., “Comparative study of physiologic characteristics between the newly compiled Bafa Wubu of tai chi and 24 form simplified tai chi,” BMC Sports Sci Med Rehabil, vol. 12, no. 1, Jul. 2020, doi: 10.1186/s13102-020-00192-x.
Y. Chen et al., “Effects of Tai Chi Chuan on Cognitive Function in Adults 60 Years or Older With Type 2 Diabetes and Mild Cognitive Impairment in China: A Randomized Clinical Trial,” JAMA Netw Open, vol. 6, no. 4, p. E237004, Apr. 2023, doi: 10.1001/jamanetworkopen.2023.7004.
V. S. P. Bhamidipati, I. Saxena, D. Saisanthiya, and M. Retnadhas, “Robust Intelligent Posture Estimation for an AI Gym Trainer using Mediapipe and OpenCV,” in Proceedings of the 1st IEEE International Conference on Networking and Communications 2023, ICNWC 2023, 2023. doi: 10.1109/ICNWC57852.2023.10127264.
C. Anilkumar, R. Jyothsna, S. V. Sree, and E. Gothai, “Deep Learning-Based Yoga Posture Specification Using OpenCV and Media Pipe,” Applied and Computational Engineering, vol. 8, no. 1, pp. 80–86, Aug. 2023, doi: 10.54254/2755-2721/8/20230085.
R. Gajbhiye, S. Jarag, P. Gaikwad, and S. Koparde, “AI Human Pose Estimation: Yoga Pose Detection and Correction,” 2022.
Y.-F. Jan, K.-W. Tseng, P.-Y. Kao, and Y.-P. Hung, “Augmented Tai-Chi Chuan Practice Tool with Pose Evaluation,” 2021. doi: 10.1109/MIPR51284.2021.00013.
X. Q. Cai, Y. Q. Huo, F. J. Li, and H. Y. Sun, “Human pose estimation and similarity calculation for Tai Chi learning,” Journal of Graphics, vol. 43, no. 4, pp. 695–706, Aug. 2022, doi: 10.11996/JG.j.2095-302X.2022040695.
C. Lugaresi et al., “MediaPipe: A Framework for Building Perception Pipelines,” Jun. 2019, [Online]. Available: http://arxiv.org/abs/1906.08172
Z. Cao, G. Hidalgo, T. Simon, S.-E. Wei, and Y. Sheikh, “OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields,” Dec. 2018, [Online]. Available: http://arxiv.org/abs/1812.08008
N. Singla, “Motion Detection Based on Frame Difference Method,” 2014.
K. K. Devyanti, “Pembelajaran Tari Remo Bolet Melalui Metode Drill and Practice Pada Ekstrakurikuler Tari Di Smpn 43 Surabaya,” Jurnal Pendidikan Sendratasik, vol. 12, no. 1, 2023.
Health Research Institute, “TAI CHI-A THERAPEUTIC OUTLINE.” Western Sydney University, 2021
H. Li, F. Peng, S. Lyu, Z. Ji, X. Li, and M. Liu, “Newly compiled Tai Chi (Bafa Wubu) promotes lower extremity exercise: a preliminary cross sectional study,” PeerJ, vol. 11, 2023, doi: 10.7717/peerj.15036.
J. Zhang et al., “The effect of Bafa Wubu of Tai Chi on college students’ anxiety and depression: A randomized, controlled pilot study,” Front Physiol, vol. 14, Jan. 2023, doi: 10.3389/fphys.2023.1036010.
J. Zhang et al., “The effect of Bafa Wubu of Tai Chi on college students’ anxiety and depression: A randomized, controlled pilot study,” Front Physiol, vol. 14, Jan. 2023, doi: 10.3389/fphys.2023.1036010.
D. Liu and J. Liu, “EFFECT OF TAI-JI PRACTICE ON THE HEALTH OF THE ELDERLY,” Revista Brasileira de Medicina do Esporte, vol. 29, 2023, doi: 10.1590/1517-8692202329012022_0707.
J. W. Kim, J. Y. Choi, E. J. Ha, and J. H. Choi, “Human Pose Estimation Using MediaPipe Pose and Optimization Method Based on a Humanoid Model,” Applied Sciences (Switzerland), vol. 13, no. 4, Feb. 2023, doi: 10.3390/app13042700.
H. U. R. Siddiqui et al., “Enhancing Cricket Performance Analysis with Human Pose Estimation and Machine Learning,” Sensors, vol. 23, no. 15, Aug. 2023, doi: 10.3390/s23156839.
R. C. Chen, C. Dewi, S. W. Huang, and R. E. Caraka, “Selecting critical features for data classification based on machine learning methods,” J Big Data, vol. 7, no. 1, 2020, doi: 10.1186/s40537-020-00327-4.
P. Y. Simard, D. Steinkraus, and J. C. Platt, “Best practices for convolutional neural networks applied to visual document analysis,” in Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, 2003. doi: 10.1109/ICDAR.2003.1227801.
I. Rodríguez-Rodríguez, J. V. Rodríguez, N. Shirvanizadeh, A. Ortiz, and D. J. Pardo-Quiles, “Applications of artificial intelligence, machine learning, big data and the internet of things to the COVID-19 pandemic: A scientometric review using text mining,” 2021. doi: 10.3390/ijerph18168578.
I. H. Sarker, M. M. Hoque, M. K. Uddin, and T. Alsanoosy, “Mobile Data Science and Intelligent Apps: Concepts, AI-Based Modeling and Research Directions,” Mobile Networks and Applications, vol. 26, no. 1, pp. 285–303, Feb. 2021, doi: 10.1007/s11036-020-01650-z.
I. H. Sarker, “Machine Learning: Algorithms, Real-World Applications and Research Directions,” May 01, 2021, Springer. doi: 10.1007/s42979-021-00592-x.
H. Abbasimehr and R. Paki, “Improving time series forecasting using LSTM and attention models,” J Ambient Intell Humaniz Comput, vol. 13, no. 1, 2022, doi: 10.1007/s12652-020-02761-x.
T. B. de G. Lafayette et al., “Validation of Angle Estimation Based on Body Tracking Data from RGB-D and RGB Cameras for Biomechanical Assessment,” Sensors, vol. 23, no. 1, Jan. 2023, doi: 10.3390/s23010003.
S. Sajan and A. Anilkumar, “Pose Estimated Yoga Monitoring System.” 2021, [Online]. Available: https://ssrn.com/abstract=3882498
Y. Kwon and D. Kim, “Real-Time Workout Posture Correction using OpenCV and MediaPipe,” The Journal of Korean Institute of Information Technology, vol. 20, no. 1, pp. 199–208, Jan. 2022, doi: 10.14801/jkiit.2022.20.1.199.
D. W. Apley and J. Zhu, “Visualizing the effects of predictor variables in black box supervised learning models,” J R Stat Soc Series B Stat Methodol, vol. 82, no. 4, 2020, doi: 10.1111/rssb.12377.
A. Muthalib, “Implementation of Human Pose Estimation Using Angle Calculation Logic on The Elder of The Hands as a Fitness Repetition” 2022, doi: 10.52088/ijesty.v1i4.346.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Personal Training with Tai Chi: Classifying Movement using Mediapipe Pose Estimation and LSTM
Pages: 767-775
Copyright (c) 2024 vartin suhandi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
