Klasifikasi Multi Label untuk Deteksi Keseimbangan Emosi Pengguna Media Sosial Menggunakan K-Fold Cross Validation
- Titik Misriati Universitas Bina Sarana Informatika, Jakarta, Indonesia
-
Riska Aryanti
*
Universitas Bina Sarana Informatika, Jakarta,
Indonesia
- Asriyani Sagiyanto Universitas Bina Sarana Informatika, Jakarta, Indonesia
- Muhamad Fachri Universitas Bina Sarana Informatika, Jakarta, Indonesia
- Arya Ramadhani Universitas Bina Sarana Informatika, Jakarta, Indonesia (*) Corresponding Author
Abstract
Social media has grown in popularity, with millions of people using it to engage with and share information worldwide. Social media, in addition to serving as a communication tool, are crucial for expressing the emotions and feelings of users. The widespread use of social media has had a significant impact on people's emotions. In particular, negative emotions are frequently experienced and can have a significant impact on mental health. This study aimed to analyze multiple classification models to discover the optimal model for detecting emotional balance among social media users. The classification models utilized in this study include the K-Nearest Neighbor, Random Forest, Support Vector Machine, Decision Tree, and AdaBoost to identify the best classification model capable of detecting the emotional balance of social media users. Several classification models are applied and compared with the aim of evaluating model performance. This research project employed K-fold cross-validation to evaluate the categorization model by comparing various k values. The Random Forest algorithm achieved the greatest accuracy of 99.90% at a K-Fold cross validation value of 10 and an Area Under the Curve (AUC) value of 100%. Thus, this study successfully found a reliable model for accurately detecting emotions of social media users, which is expected to contribute to the development of mental well-being monitoring systems on social media platforms.
Downloads
References
M. Schreiner, T. Fischer, and R. Riedl, “Impact of Content Characteristics and Emotion on Behavioral Engagement in Social Media: Literature Review and Research Agenda,” Electronic Commerce Research, vol. 21, no. 2, pp. 329–345, Jun. 2021, doi: 10.1007/s10660-019-09353-8.
N. Hicham, S. Karim, and N. Habbat, “Customer sentiment analysis for Arabic social media using a novel ensemble machine learning approach,” International Journal of Electrical and Computer Engineering, vol. 13, no. 4, pp. 4504–4515, Aug. 2023, doi: 10.11591/ijece.v13i4.pp4504-4515.
R. Dolan, J. Conduit, C. Frethey-Bentham, J. Fahy, and S. Goodman, “Social Media Engagement Behavior,” Eur J Mark, vol. 53, no. 10, pp. 2213–2243, Oct. 2019, doi: 10.1108/EJM-03-2017-0182.
J. A. Naslund, A. Bondre, J. Torous, and K. A. Aschbrenner, “Social Media and Mental Health: Benefits, Risks, and Opportunities for Research and Practice,” J Technol Behav Sci, vol. 5, no. 3, pp. 245–257, Sep. 2020, doi: 10.1007/s41347-020-00134-x.
M. A. Moreno and A. F. Jolliff, “Depression and Anxiety in the Context of Digital Media,” in Handbook of Adolescent Digital Media Use and Mental Health, Cambridge University Press, 2022, pp. 217–241. doi: 10.1017/9781108976237.013.
S. Salsabillah, N. R. Siregar, and Y. A. Pambudhi, “Intensitas Penggunaan Media Sosial dengan Kestabilan Emosi pada Mahasiswa Kedokteran,” Jurnal Sublimapsi, vol. 4, no. 2, p. 247, May 2023, doi: 10.36709/sublimapsi.v4i2.29321.
K. Rani, F. Fatima, and A. Kumar, “Influence of Social Media on Educational and Mental Wellbeing of Young Minds: A Critical Analysis,” International Journal For Multidisciplinary Research, vol. 6, no. 4, Jul. 2024, doi: 10.36948/ijfmr.2024.v06i04.24666.
N. Pacocha and O. Gugała, “The Influence of Social Media on Mental Wellbeing - A Review of Literature,” International Journal of Innovative Technologies in Social Science, no. 2(42), May 2024, doi: 10.31435/rsglobal_ijitss/30062024/8151.
A. Mulder, K. Kingsley, D. Camacho, and J. Lasprilla, “Adolescent Emotional Well-Being and Social Media Addiction: The COVID-19 Pandemic’s Influence on Mental Health,” Med Res Arch, vol. 12, no. 5, 2024, doi: 10.18103/mra.v12i5.5289.
F. A. Acheampong, C. Wenyu, and H. Nunoo‐Mensah, “Text‐Based Emotion Detection: Advances, Challenges, and Opportunities,” Engineering Reports, vol. 2, no. 7, Jul. 2020, doi: 10.1002/eng2.12189.
M. L. BĂRHALESCU and E. COSTESCU, “The Role of Social Media in User Health,” Journal of Marine Technology and Environment, vol. 2, no. 2, pp. 7–11, Oct. 2023, doi: 10.53464/JMTE.02.2023.01.
A. M. Abubakar, D. Gupta, and S. Palaniswamy, “Explainable Emotion Recognition from Tweets using Deep Learning and Word Embedding Models,” in 2022 IEEE 19th India Council International Conference (INDICON), IEEE, Nov. 2022, pp. 1–6. doi: 10.1109/INDICON56171.2022.10039878.
P. Kumar and B. Raman, “A BERT Based Dual-Channel Explainable Text Emotion Recognition System,” Neural Networks, vol. 150, pp. 392–407, Jun. 2022, doi: 10.1016/j.neunet.2022.03.017.
Y. Astari, A. Afiyati, and S. W. Rozaqi, “Analisis Sentimen Multi-Class pada Sosial Media menggunakan metode Long Short-Term Memory (LSTM),” Jurnal Linguistik Komputasional, vol. 4, no. 1, pp. 8–12, 2021, doi: 10.26418/jlk.v4i1.43.
S. Sudianto, “Analisis Kinerja Algoritma Machine Learning Untuk Klasifikasi Emosi,” Building of Informatics, Technology and Science (BITS), vol. 4, no. 2, Sep. 2022, doi: 10.47065/bits.v4i2.2261.
I. G. Harsemadi, I. K. Dharmendra, and I. M. P. P. Wijaya, “Klasifikasi Emosi Pada Tweet Berbahasa Indonesia Menggunakan Teknik Sampling ENN,” Jurnal Teknologi Informasi dan Komputer, vol. 9, no. 5, Oct. 2023, doi: 10.36002/jutik.v9i5.2646.
A. Sujjada and Anggun Fergina, “Implementasi Metode Vector Space Model untuk Deteksi Emosi Menggunakan Data Teks Twitter,” Jurnal RESTIKOM : Riset Teknik Informatika dan Komputer, vol. 3, no. 3, pp. 116–129, Jun. 2022, doi: 10.52005/restikom.v3i3.89.
E. Bulut, “Social Media Usage and Emotional Well-being,” Kaggle. Access Date Sept 2024 [Online]. Available: https://www.kaggle.com/datasets/emirhanai/social-media-usage-and-emotional-well-being
V. Kumar, S. Kumar, and S. Sarangi, “Effect of Sampling Rate on Parametric and Non-parametric Data Preprocessing for Gearbox Fault Diagnosis,” Journal of Vibration Engineering & Technologies, vol. 12, no. 2, pp. 1195–1202, Feb. 2024, doi: 10.1007/s42417-023-00901-z.
T. I. Fajri et al., Data Mining. Payakumbuh: PT. Serasi Media Teknologi, 2024.
D. Brown, “Model Selection Through Cross-Validation for Supervised Learning Tasks with Manifold Data,” The Journal of Purdue Undergraduate Research, vol. 13, no. 1, Jan. 2024, doi: 10.7771/2158-4052.1585.
V. Q. Noor, R. Herfiansyah, A. S. Ramadhan, and A. Amali, “Prediksi Diabetes Menggunakan Algoritma Naive Bayes Menggunakan Rapidminer,” Pelita Teknologi, vol. 19, no. 1, pp. 16–21, Mar. 2024, doi: 10.37366/pelitatekno.v19i1.4329.
A. Muhaimin, W. Wibowo, and P. A. Riyantoko, “Multi-label Classification Using Vector Generalized Additive Model via Cross-Validation,” Journal of Information and Communication Technology, vol. 22, 2023, doi: 10.32890/jict2023.22.4.5.
I. Kurniawan and P. B. Santoso, “Design of K-Nearest Neighbor Algorithm For Classification of Credit Loan Eligibility At Senarak Dana Purwakarta Cooperative,” Internet of Things and Artificial Intelligence Journal, vol. 4, no. 2, pp. 354–370, Jun. 2024, doi: 10.31763/iota.v4i2.742.
K. Iyer, A. Shukla, K. Sharma, and M. Varghese, “Speech Emotion Recognition using Gaussian Mixture Model (GMM) and K-Nearest Neighbors (KNN),” in Advancements in Communication and Systems, Soft Computing Research Society, 2024, pp. 443–455. doi: 10.56155/978-81-955020-7-3-39.
P. P. Putra, M. K. Anam, S. Defit, and A. Yunianta, “Enhancing the Decision Tree Algorithm to Improve Performance Across Various Datasets,” INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi, vol. 8, no. 2, pp. 200–212, Aug. 2024, doi: 10.29407/intensif.v8i2.22280.
N. Celiker and C. O. Guzeller, “Predicting Organizational Citizenship Behaviour in Hospitality Businesses with Decision Tree Method,” International Journal of Hospitality & Tourism Administration, vol. 25, no. 2, pp. 436–474, Mar. 2024, doi: 10.1080/15256480.2022.2120942.
I. D. Mienye and N. Jere, “A Survey of Decision Trees: Concepts, Algorithms, and Applications,” IEEE Access, vol. 12, pp. 86716–86727, 2024, doi: 10.1109/ACCESS.2024.3416838.
R. F. Putra et al., Algoritma Pembelajaran Mesin: Dasar, Teknik, dan Aplikasi. Jambi: PT. Sonpedia Publishing Indonesia, 2024.
S. Madanian et al., “Speech emotion recognition using machine learning - A systematic review,” Intelligent Systems with Applications, vol. 20, p. 200266, Nov. 2023, doi: 10.1016/j.iswa.2023.200266.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Klasifikasi Multi Label untuk Deteksi Keseimbangan Emosi Pengguna Media Sosial Menggunakan K-Fold Cross Validation
Pages: 697-704
Copyright (c) 2024 Titik Misriati, Riska Aryanti, Asriyani Sagiyanto, Muhamad Fachri, Arya Ramadhani
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
