Hybrid Two-Stage CatBoost and Multilayer Perceptron Model for Sleep Disorder Classification


  • Visal Ady Yanuar * Mail Dian Nuswantoro University, Semarang, Indonesia
  • Aripin Aripin Dian Nuswantoro University, Semarang, Indonesia
  • (*) Corresponding Author
Keywords: Sleep Disorders; Classification; Hybrid Two-Stage; CatBoost; Multilayer Perceptron

Abstract

Sleep disorders are a health problem that significantly impacts quality of life and potentially increases the risk of various chronic diseases. Conventional sleep disorder diagnosis generally requires expensive and complex examinations, so an alternative, non-invasive data-driven approach is needed. This study proposes a sleep disorder classification approach based on tabular medical data using a Hybrid Two-Stage architecture. The proposed approach integrates the CatBoost algorithm as a binary screening stage to distinguish healthy individuals from individuals with sleep disorders, and a Multilayer Perceptron (MLP) as a latent feature extractor, combined with CatBoost to classify sleep disorder subtypes, namely insomnia and sleep apnea. The datasets used were obtained from two public data sources and evaluated using a stratified k-fold cross-validation scheme. Class imbalance was addressed using the SMOTE-ENN technique, while hyperparameter optimization was applied as part of the model training pipeline. Performance evaluation was conducted using accuracy, Macro-F1, and Matthews Correlation Coefficient (MCC) metrics. Experimental results show that the Hybrid Two-Stage architecture achieves an accuracy of 94.1%, a Macro-F1 of 0.90, and an MCC of 0.88, and exhibits stable performance across a wide range of fold variations. These results demonstrate that the hybrid two-stage approach is effective in improving the performance of sleep disorder classification based on medical tabular data. The main contribution of this study is the development of a two-stage hybrid classification framework that explicitly separates healthy-disorder screening and sleep disorder subtype classification, while integrating SMOTE-ENN, Optuna-based hyperparameter optimization, and MLP-derived latent feature representation to improve classification stability on imbalanced medical tabular data.

Downloads

Download data is not yet available.

References

G. Medic, M. Wille, and M. Hemels, “Short- and long-term health consequences of sleep disruption,” Nat. Sci. Sleep, vol. 9, pp. 151–161, May 2017, doi: 10.2147/NSS.S134864.

R. Alazaidah, G. Samara, M. Aljaidi, M. Haj Qasem, A. Alsarhan, and M. Alshammari, “Potential of Machine Learning for Predicting Sleep Disorders: A Comprehensive Analysis of Regression and Classification Models,” Diagnostics, vol. 14, no. 1, p. 27, Dec. 2023, doi: 10.3390/diagnostics14010027.

M. Mostafa Monowar et al., “Advanced sleep disorder detection using multi-layered ensemble learning and advanced data balancing techniques,” Front. Artif. Intell., vol. 7, Jan. 2025, doi: 10.3389/frai.2024.1506770.

A. A. Alhussan, E.-S. M. El-Kenawy, D. S. Khafaga, and M. M. Eid, “Enhancing sleep disorder classification using machine learning and metaheuristic optimization techniques,” Biomed. Signal Process. Control, vol. 110, p. 108204, Dec. 2025, doi: 10.1016/j.bspc.2025.108204.

N. Nuraeni and M. Faisal, “Classification of Sleep Disorders Using Support Vector Machine,” Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, Jan. 2025, doi: 10.22219/kinetik.v10i1.2054.

T. Misriati and R. Aryanti, “Optimasi klasifikasi gangguan tidur pada dataset tidak seimbang menggunakan SMOTE dan algoritma machine learning,” Jurnal Teknoinfo, vol. 19, no. 2, pp. 128–136, Jul. 2025, doi: 10.33365/teknoinfo.v19i2.295.

T. U. Wara, A. H. Fahad, A. S. Das, and M. M. H. Shawon, “A systematic review on sleep stage classification and sleep disorder detection using artificial intelligence,” Heliyon, vol. 11, no. 12, p. e43576, Jul. 2025, doi: 10.1016/j.heliyon.2025.e43576.

E. Dritsas and M. Trigka, “Utilizing Multi-Class Classification Methods for Automated Sleep Disorder Prediction,” Information, vol. 15, no. 8, p. 426, Jul. 2024, doi: 10.3390/info15080426.

M. Hamid, F. Hajjej, A. S. Alluhaidan, and N. W. bin Mannie, “Fine tuned CatBoost machine learning approach for early detection of cardiovascular disease through predictive modeling,” Sci. Rep., vol. 15, no. 1, Dec. 2025, doi: 10.1038/s41598-025-13790-x.

T. Akiba, S. Sano, T. Yanase, T. Ohta, and M. Koyama, “Optuna: A next-generation hyperparameter optimization framework,” in Proc. 25th ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., 2019, pp. 2623–2631, doi: 10.1145/3292500.3330701.

M. A. Ridla and A. A. Bawazin, “Klasifikasi gangguan tidur berdasarkan gaya hidup menggunakan algoritma Decision Tree,” Journal of Information System and Application Development, vol. 3, no. 2, pp. 118–125, 2025, doi: 10.26905/jisad.v3i2.16038.

Y. Zhao, “Automatic Sleep Disorder Classification Using Large Language Model Prompting on Sleep Health and Lifestyle Data,” Mar. 03, 2025. doi: 10.21203/rs.3.rs-6124845/v1.

G. Airlangga, “Evaluating hybrid neural network architectures for predicting sleep disorders from structured data,” JIKO (Jurnal Informatika dan Komputer), vol. 7, no. 1, pp. 58–64, Apr. 2024, doi: 10.33387/jiko.v7i1.7873.

G. Airlangga, “Evaluating machine learning models for predicting sleep disorders in a lifestyle and health data context,” JIKO (Jurnal Informatika dan Komputer), vol. 7, no. 1, pp. 51–57, Apr. 2024, doi: 10.33387/jiko.v7i1.7870.

P. Refaeilzadeh, L. Tang, and H. Liu, “Cross-Validation,” in Encyclopedia of Database Systems, Boston, MA: Springer US, 2009, pp. 532–538. doi: 10.1007/978-0-387-39940-9_565.

N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic minority over-sampling technique,” J. Artif. Intell. Res., vol. 16, pp. 321–357, 2002, doi: 10.1613/jair.953.

L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, “CatBoost: Unbiased boosting with categorical features,” in Advances in Neural Information Processing Systems, vol. 31, 2018, pp. 6639–6649.

H.-T. Cheng et al., “Wide & deep learning for recommender systems,” in Proc. 1st Workshop on Deep Learning for Recommender Systems, 2016, pp. 7–10, doi: 10.1145/2988450.2988454.

F. Sebastiani, “Machine learning in automated text categorization,” ACM Comput. Surv., vol. 34, no. 1, pp. 1–47, Mar. 2002, doi: 10.1145/505282.505283.

J. Davis and M. Goadrich, “The relationship between Precision-Recall and ROC curves,” in Proc. 23rd Int. Conf. Mach. Learn. (ICML ’06), New York, NY, USA: ACM Press, 2006, pp. 233–240, doi: 10.1145/1143844.1143874.

D. Chicco and G. Jurman, “The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation,” BMC Genomics, vol. 21, no. 1, p. 6, Dec. 2020, doi: 10.1186/s12864-019-6413-7.


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Hybrid Two-Stage CatBoost and Multilayer Perceptron Model for Sleep Disorder Classification

Dimensions Badge
Article History
Submitted: 2026-05-14
Published: 2026-06-30
Abstract View: 0 times
PDF Download: 0 times
How to Cite
Yanuar, V. A., & Aripin, A. (2026). Hybrid Two-Stage CatBoost and Multilayer Perceptron Model for Sleep Disorder Classification. Building of Informatics, Technology and Science (BITS), 8(1), 590-600. https://doi.org/10.47065/bits.v8i1.9958
Issue
Section
Articles