Sign Language Translator Based on Raspberry Pi Camera Using The Haar Cascade Classifier Method
-
Gempur Bayu Aji
*
Telkom University, Bandung,
Indonesia
- Fazmah Arif Yulianto Telkom University, Bandung, Indonesia
- Andrian Rakhmatsyah Telkom University, Bandung, Indonesia (*) Corresponding Author
Abstract
Sign language is the main tool of communication for people with hearing impairments. Communication is very limited and difficult to understand between normal people who do not know sign language, so an interpreter is needed. Where not everyone, even a few normal people, learns sign language, especially the Indonesian Sign Language System (SIBI). Motion Detection is an important subject in the field of computer vision, which is used by many systems. Today's Internet of Things is very helpful and facilitates daily human activities. An internet network allows a device to be controlled from a considerable distance. This study described a sign language translator tool for the deaf and speech impaired using a raspberry-pi camera and displayed it on the other device monitor. This system was built using the Python programming language and the OpenCV Library. The system is using Haar Cascade Classifier algorithm, where there will be data on all hand shapes based on the letters to be translated. This application uses the OpenCV library and Visual Studio Code IDE software connected to the Raspberry Pi Camera. The publisher will send data to other devices using the MQTT Broker to connect and display detection results to other device monitors wirelessly using a local network. The research was conducted at various distances between the hand and the webcam, from 30cm to 150cm. The research results using the Haar Cascade Classifier method to detect sign language obtained an accuracy of 82%.
Downloads
References
A. Basuki, M. Zikky, J. Akhmad Nur Hasim, and N. Ilham Ramadhan, “Prosiding SENTIA 2016-Politeknik Negeri Malang SENSOR GERAK DENGAN LEAP MOTION UNTUK MEMBANTU KOMUNIKASI TUNA RUNGU/WICARA,” 2016.
N. Khamdi and M. Raja Adrafi, “Sarung Tangan Cerdas Sebagai Translator Bahasa Isyarat untuk Tuna Wicara,” 2022. [Online]. Available: https://jurnal.pcr.ac.id/index.php/elementer
D. Rohpandi, A. Sugiharto, M. Yoga, and S. Jati, “Klasifikasi Citra Digital Berbasis Ekstraksi Ciri Berdasarkan Tekstur Menggunakan GLCM Dengan Algoritma K-Nearest Neighbor.”
H. Muchtar and R. Apriadi, “Implementasi Pengenalan Wajah Pada Sistem Penguncian Rumah dengan Metode Template Matching Menggunakan Open Source Computer Vision Library (Opencv),” vol. 2, no. 1, 2019.
Imadudin Harjanto, “IoT Gateway Menggunakan Protokol MQTT pada Perangkat Kendali Berbasis Modbus-RTU,” Jurnal Ilmiah Teknosains, vol. 6, no. 1, May 2020.
R. Prathivi and Y. Kurniawati, “SISTEM PRESENSI KELAS MENGGUNAKAN PENGENALAN WAJAH DENGAN METODE HAAR CASCADE CLASSIFIER,” Simetris: Jurnal Teknik Mesin, Elektro dan Ilmu Komputer, vol. 11, no. 1, pp. 135–142, Apr. 2020, Accessed: Jan. 22, 2023. [Online]. Available: https://jurnal.umk.ac.id/index.php/simet/article/view/3754
G. A. Anarki, K. Auliasari, and M. Orisa, “PENERAPAN METODE HAAR CASCADE PADA APLIKASI DETEKSI MASKER,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 5, no. 1, pp. 179–186, Feb. 2021, doi: 10.36040/JATI.V5I1.3214.
C. A. Saputra, D. Erwanto, P. N. Rahayu, and I. Kadiri, “Deteksi Kantuk Pengendara Roda Empat Menggunakan Haar Cascade Classifier Dan Convolutional Neural Network,” Journal of Electrical Engineering and Computer (JEECOM), vol. 3, no. 1, pp. 1–7, Apr. 2021, doi: 10.33650/JEECOM.V3I1.1510.
M. F. Mustaqim, A. Nugroho, D. Alfa, and F. Suni, “Sistem Deteksi Kecepatan Kendaraan Menggunakan Metode Haar Cascade untuk Keamanan Berkendara,” Edu Elektrika Journal, vol. 10, no. 2, pp. 30–34, Dec. 2021, doi: 10.15294/EEJ.V10I2.47870.
Sugianto Sugianto, Endang Setyati, and Hendrawan Armanto, “DETEKSI ALAT PELINDUNG KEPALA (HELM) MENGGUNAKAN METODE HAAR CASCADE CLASSIFIER | Sugianto | Joutica : Journal of Informatic Unisla,” 2019. http://www.jurnalteknik.unisla.ac.id/index.php/informatika/article/view/283 (accessed Jan. 22, 2023).
A. Chandra Saputra et al., “RANCANG BANGUN APLIKASI NEW NORMAL COVID-19 DETEKSI PENGGUNAAN MASKER MENGGUNAKAN HAAR CASCADE CLASSIFIER,” Jurnal Teknologi Informasi: Jurnal Keilmuan dan Aplikasi Bidang Teknik Informatika, vol. 15, no. 2, pp. 199–209, Aug. 2021, doi: 10.47111/JTI.V15I2.3291.
M. P. Alfian, J. Raharjo, and N. Ibrahim, “Perancangan Sistem Pendeteksi Kepadatan Lalu Lintas Menggunakan Metode Haar Cascade Classifier,” eProceedings of Engineering, vol. 9, no. 6, Jan. 2023, doi: 10.34818/EOE.V9I6.19103.
A. Presensi… et al., “APLIKASI PRESENSI PENGENALAN WAJAH DENGAN MENGGUNAKAN ALGORITMA HAAR CASCADE CLASSIFIER,” Telematika : Jurnal Informatika dan Teknologi Informasi, vol. 16, no. 2, pp. 87–96, Jan. 2020, doi: 10.31315/TELEMATIKA.V16I2.3182.G2490.
Ilham Rizaldy Widy Putra, “Sistem Deteksi Simbol pada SIBI (Sistem Isyarat Bahasa Indonesia) Menggunakan Convolutional Neural Network,” 2021.
M. Alief, Z. Syafiq, A. A. Rafiq, and H. Susanti, “PENGEMBANGAN METODE HAAR CASCADE CLASSIFIER PADA PENGENALAN MATA UNTUK SISTEM KEAMANAN BRANKAS,” Prosiding Seminar Nasional Terapan Riset Inovatif (SENTRINOV), vol. 6, no. 1, pp. 895–901, Nov. 2020, Accessed: Jan. 15, 2023. [Online]. Available: https://proceeding.isas.or.id/index.php/sentrinov/article/view/556
R. Isum, S. Maryati, and B. Tryatmojo, “AKURASI SISTEM FACE RECOGNITION OPENCV MENGGUNAKAN RASPBERRY PI DENGAN METODE HAAR CASCADE,” JURNAL ILMIAH INFORMATIKA, vol. 7, no. 02, pp. 92–98, Oct. 2019, doi: 10.33884/JIF.V7I02.1354.
M. Zulfikri et al., “Sistem Penegakan Speed Bump Berdasarkan Kecepatan Kendaraan yang Diklasifikasikan Haar Cascade Classifier,” Jurnal Teknologi dan Sistem Komputer, vol. 7, no. 1, pp. 12–18, Jan. 2019, doi: 10.14710/JTSISKOM.7.1.2019.12-18.
M. Ramli, D. J. Mamahit, and J. O. Wuwung, “Rancang Bangun Sistem Pemantau Tamu Pada Smart Home Berbasis Raspberry PI 3,” Jurnal Teknik Elektro dan Komputer, vol. 7, no. 1, pp. 1–8, Feb. 2018, doi: 10.35793/JTEK.7.1.2018.19085.
H. Sasmita, I. M. A. Nrartha, and I. M. B. Suksmadana, “PERANCANGAN ENERGI METER DAN ANALISIS KARAKTERISTIK BEBAN LISTRIK BERBASIS RASPBERRY PI,” DIELEKTRIKA, vol. 5, no. 1, pp. 64–72, Mar. 2018, doi: 10.29303/DIELEKTRIKA.V5I1.130.
M. M. al CHOEDORI, “Penerapan Image Processing Untuk Mendeteksi Pergerakan Ikan Koki Dengan Metode Cascade Classifier,” Nov. 2021, Accessed: Jan. 16, 2023. [Online]. Available: https://dspace.uii.ac.id/handle/123456789/37573
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Sign Language Translator Based on Raspberry Pi Camera Using The Haar Cascade Classifier Method
Pages: 1747−1753
Copyright (c) 2023 Gempur Bayu Aji, Fazmah Arif Yulianto, Andrian Rakhmatsyah
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
