Optimalisasi Arsitektur LSTM dengan Pendekatan Bidirectional untuk Deteksi Kantuk Pengemudi Berbasis Fitur Wajah
- Andhika Rhaifahrizal Hartono Universitas Dian Nuswantoro, Semarang, Indonesia
-
Muhammad Naufal
*
Universitas Dian Nuswantoro, Semarang,
Indonesia
- Farrikh Alzami Universitas Dian Nuswantoro, Semarang, Indonesia (*) Corresponding Author
Abstract
Traffic accidents caused by driver fatigue and drowsiness remain a serious safety concern in many countries, including Indonesia. Various image-based drowsiness detection systems have been developed, yet many still rely on single-frame analysis and lack the ability to capture complete temporal context. To address this issue, a system capable of accurately and real-time detecting signs of drowsiness is required. This study aims to evaluate and compare the performance of Long Short-Term Memory (LSTM) and Bidirectional LSTM (BiLSTM) algorithms for a facial-feature-based drowsiness detection system. The dataset used is YawDD, which consists of videos of drivers yawning and in neutral conditions. Each video was decomposed into frames and analyzed using MediaPipe to extract facial landmarks. Two main features, Eye Aspect Ratio (EAR) and Mouth Opening Ratio (MOR), were utilized. Due to class imbalance, the SMOTE technique was applied to the minority class in the training data. Both LSTM and BiLSTM models were compared under similar architecture configurations. The results show that BiLSTM outperformed LSTM with an accuracy of 94,74% and an F1- score 94,82%, compared to 92,98% accuracy and 93,22% F1-score achieved by LSTM. These findings demonstrate that bidirectional sequential processing in BiLSTM is more effective in capturing the temporal patterns of drowsiness symptoms. This study contributes to the development of accurate and efficient computer vision-based drowsiness detection systems.
Downloads
References
B. P. S. Indonesia, “Jumlah Kecelakaan, Korban Mati, Luka Berat, Luka Ringan, dan Kerugian Materi - Tabel Statistik,” https://www.bps.go.id/id/statistics-table/2/NTEzIzI=/jumlah-kecelakaan-korban-mati-luka-berat-luka-ringan-dan-kerugian-materi.html.
R. Aprianto, A. Rokhim, A. Basuki, and S. Sugiyarto, “Pengaruh Karakteristik Pengemudi Dan Pemanfaatan Rest Area Terhadap Kelelahan Pengemudi Studi Kasus Ruas Jalan Tol Pejagan - Solo,” Jurnal Keselamatan Transportasi Jalan (Indonesian Journal of Road Safety), vol. 8, pp. 92–103, May 2021, doi: 10.46447/ktj.v8i1.310.
V. A. Saeed, “A Framework for Recognition of Facial Expression Using HOG Features,” International Journal of Mathematics, Statistics, and Computer Science, vol. 2, pp. 1–8, May 2024, doi: 10.59543/IJMSCS.V2I.7815.
T. Tinaliah and T. Elizabeth, “Penerapan Convolutional Neural Network Untuk Klasifikasi Citra Ekspresi Wajah Manusia Pada MMA Facial Expression Dataset,” JATISI (Jurnal Teknik Informatika dan Sistem Informasi), vol. 8, no. 4, pp. 2051–2059, Dec. 2021, doi: 10.35957/JATISI.V8I4.1437.
L. Chen, G. Xin, Y. Liu, and J. Huang, “Driver Fatigue Detection Based on Facial Key Points and LSTM,” Security and Communication Networks, vol. 2021, pp. 1–9, Jun. 2021, doi: 10.1155/2021/5383573.
M. F. Rizkilloh and S. Widiyanesti, “Prediksi Harga Cryptocurrency Menggunakan Algoritma Long Short Term Memory (LSTM),” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 6, pp. 25–31, Feb. 2022, doi: 10.29207/resti.v6i1.3630.
Z. Ruiye, “Volleyball training video classification description using the BiLSTM fusion attention mechanism,” Heliyon, vol. 10, no. 15, p. e34735, Aug. 2024, doi: 10.1016/J.HELIYON.2024.E34735.
Y. Albadawi, A. AlRedhaei, and M. Takruri, “Real-Time Machine Learning-Based Driver Drowsiness Detection Using Visual Features,” Journal of Imaging 2023, Vol. 9, Page 91, vol. 9, no. 5, p. 91, Apr. 2023, doi: 10.3390/JIMAGING9050091.
S. Abtahi, M. Omidyeganeh, S. Shirmohammadi, and B. Hariri, “YawDD: Yawning Detection Dataset,” IEEE Dataport, pp. 24–28, Aug. 2020, doi: 10.21227/e1qm-hb90.
J. R. González-Rodríguez, D. M. Córdova-Esparza, J. Terven, and J. A. Romero-González, “Towards a Bidirectional Mexican Sign Language–Spanish Translation System: A Deep Learning Approach,” Technologies (Basel), vol. 12, no. 1, Jan. 2024, doi: 10.3390/TECHNOLOGIES12010007.
D. Kantuk Untuk Keamanan Berkendara Berbasis Pengolahan Citra, C. Kurniawan Umbu Nggiku, and A. Rabi, “Deteksi Kantuk Untuk Keamanan Berkendara Berbasis Pengolahan Citra,” Jurnal JEETech, vol. 4, no. 1, pp. 48–56, Sep. 2023, doi: 10.32492/JEETECH.V4I1.4107.
T. Zhu et al., “Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences,” Applied Sciences 2022, Vol. 12, Page 2224, vol. 12, no. 4, p. 2224, Feb. 2022, doi: 10.3390/APP12042224.
G. Huang, D. Wang, Y. Du, Q. Zhang, Z. Bai, and C. Wang, “Deformation Feature Extraction for GNSS Landslide Monitoring Series Based on Robust Adaptive Sliding-Window Algorithm,” Front Earth Sci (Lausanne), vol. 10, Apr. 2022, doi: 10.3389/feart.2022.884500.
F. Hamidy and I. Yasin, “Penerapan Metode Moving Average Dalam Penentuan Harga Pokok Penjualan Barang Berbasis Web,” CHAIN: Journal of Computer Technology, Computer Engineering, and Informatics, vol. 2, pp. 67–76, Apr. 2024, doi: 10.58602/chain.v2i2.115.
E. Sutanty, Maukar, D. K. Astuti, and Handayani, “Penerapan Model Arsitektur VGG16 Untuk Klasifikasi Jenis Sampah,” Decode: Jurnal Pendidikan Teknologi Informasi, vol. 3, no. 2, pp. 407–419, Sep. 2023, doi: 10.51454/DECODE.V3I2.331.
B. Deepa and K. Ramesh, “Epileptic seizure detection using deep learning through min max scaler normalization,” Int J Health Sci (Qassim), pp. 10981–10996, May 2022, doi: 10.53730/ijhs.v6ns1.7801.
Muljono, S. A. Wulandari, H. Al Azies, M. Naufal, W. A. Prasetyanto, and F. A. Zahra, “Breaking Boundaries in Diagnosis: Non-Invasive Anemia Detection Empowered by AI,” IEEE Access, vol. 12, pp. 9292–9307, 2024, doi: 10.1109/ACCESS.2024.3353788.
Karthiek. Reddy Bokka, Shubhangi. Hora, Tanuj. Jain, and Monicah. Wambugu, Deep Learning for Natural Language Processing : Solve Your Natural Language Processing Problems with Smart Deep Neural Networks. Birmingham: Packt Publishing, Limited, 2019.
G. Fajar Shidik et al., “LUTanh Activation Function to Optimize BI-LSTM in Earthquake Forecasting,” International Journal of Intelligent Engineering and Systems, vol. 17, no. 1, 2024, doi: 10.22266/ijies2024.0229.48.
A. Zhang, Z. C. Lipton, M. Li, and A. J. Smola, Dive Into Deep Learning. Cambridge University Press, 2023.
Z. Hameed and B. Garcia-Zapirain, “Sentiment Classification Using a Single-Layered BiLSTM Model,” IEEE Access, vol. 8, pp. 73992–74001, Apr. 2020, doi: 10.1109/ACCESS.2020.2988550.
M. Naufal, H. Al Azies, and R. M. Brilianto, “Enhanced Brain Tumor Classification through Gamma Correction in Deep Learning,” SISTEMASI, vol. 13, no. 6, pp. 2348–2358, Nov. 2024, doi: 10.32520/STMSI.V13I6.4474.
I. K. Trisiawan, Y. Yuliza, F. Supegina, and S. Attamimi, “Penerapan Multi-Label Image Classification Menggunakan Metode Convolutional Neural Network (CNN) Untuk Sortir Botol Minuman,” Jurnal Teknologi Elektro, vol. 13, no. 1, pp. 48–54, Feb. 2022, doi: 10.22441/JTE.2022.V13I1.009.
S. Clara et al., “Implementasi Seleksi Fitur pada Algoritma Klasifikasi Machine Learning untuk Prediksi Penghasilan pada Adult Income Dataset,” Prosiding Seminar Nasional Mahasiswa Bidang Ilmu Komputer dan Aplikasinya, vol. 2, no. 1, pp. 741–747, Jul. 2021, Accessed: Aug. 06, 2025. [Online]. Available: https://conference.upnvj.ac.id/index.php/senamika/article/view/1417
S. Abtahi, M. Omidyeganeh, S. Shirmohammadi, and B. Hariri, “YawDD: A yawning detection dataset,” Proceedings of the 5th ACM Multimedia Systems Conference, MMSys 2014, pp. 24–28, 2014, doi: 10.1145/2557642.2563678.
C. Aj. Saputra, D. Erwanto, and P. N. Rahayu, “Deteksi Kantuk Pengendara Roda Empat Menggunakan Haar Cascade Classifier Dan Convolutional Neural Network,” JEECOM Journal of Electrical Engineering and Computer, vol. 3, no. 1, pp. 1–7, Apr. 2021, doi: 10.33650/JEECOM.V3I1.1510.
A. Julianto, A. Sunyoto, D. Ferry, and W. Wibowo, “Optimasi Hyperparameter Convolutional Neural Network Untuk Klasifikasi Penyakit Tanaman Padi,” TEKNIMEDIA: Teknologi Informasi dan Multimedia, vol. 3, no. 2, pp. 98–105, Dec. 2022, doi: 10.46764/TEKNIMEDIA.V3I2.77.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Optimalisasi Arsitektur LSTM dengan Pendekatan Bidirectional untuk Deteksi Kantuk Pengemudi Berbasis Fitur Wajah
Pages: 1343-1354
Copyright (c) 2025 Andhika Rhaifahrizal Hartono, Muhammad Naufal, Farrikh Alzami
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
