Komparasi Naïve Bayes, SVM, dan Decision Tree untuk Klasifikasi Komentar Provokatif pada Instagram Terkait Aksi Demonstrasi Agustus 2025
-
Muhamad Yusuf
*
Universitas Muhammadiyah Prof. Dr. Hamka, Jakarta,
Indonesia
- Erizal Erizal Universitas Muhammadiyah Prof. Dr. Hamka, Jakarta, Indonesia (*) Corresponding Author
Abstract
The accelerating growth of social media has transformed digital platforms into spaces where people express opinions on social and political issues. One event that generated numerous public comments was the demonstration held on August 25–31, 2025. Many comments contained harsh language, provocation, insults, and calls for conflict that had the potential to trigger negative emotions in digital spaces. This study aims to classify provocative and non-provocative comments on Instagram using the Naïve Bayes algorithm and compare its performance with Support Vector Machine (SVM) and Decision Tree algorithms. The data were collected through a web scraping process, resulting in 3,396 comments. After the cleansing and preprocessing stages, the dataset was reduced to 2,490 comments. The preprocessing stages included transform case, tokenizing, stopwords removal, filter tokens, and stemming. Furthermore, word weighting was carried out using the TF-IDF method and implemented in RapidMiner with an 80:20 data split ratio. Based on manual labeling, 1,279 provocative comments and 1,211 non-provocative comments were obtained. The evaluation results showed that Naïve Bayes achieved an accuracy of 72.15%, SVM achieved 69.44%, and Decision Tree achieved 72.91%. Although Decision Tree produced a slightly higher accuracy, Naïve Bayes demonstrated a more balanced performance in detecting both comment classes, even though the accuracy value was still in the moderate category. The findings provide insights into the effectiveness of machine learning algorithms for identifying provocative comments and may support the development of automated content moderation on social media platforms.
Downloads
References
S. Kemp, “Digital 2024: Indonesia,” 2024. Accessed: Sep. 16, 2025. [Online]. Available: https://datareportal.com/reports/digital-2024-indonesia
K. H. Yunior, A. V. Vitianingsih, S. Kacung, A. Lidya Maukar, and A. Dwi Arumsari, “Sentiment Analysis of Cyberbullying Detection on Social Networks using the Sentistrenght Method,” Sistemasi: Jurnal Sistem Informasi, vol. 13, no. 4, 2024, doi: 10.32520/stmsi.v13i4.4226.
M. O. Ibrohim and I. Budi, “Hate speech and abusive language detection in Indonesian social media: Progress and challenges,” Heliyon, vol. 9, no. 8, p. e18647, 2023, doi: 10.1016/j.heliyon.2023.e18647.
Anjum and R. Katarya, “Hate speech, toxicity detection in online social media: a recent survey of state of the art and opportunities,” Int. J. Inf. Secur., vol. 23, no. 1, pp. 577–608, 2024, doi: 10.1007/s10207-023-00755-2.
G. Ramos et al., “A comprehensive review on automatic hate speech detection in the age of the transformer,” Soc. Netw. Anal. Min., vol. 14, no. 1, p. 204, 2024, doi: 10.1007/s13278-024-01361-3.
S. Saha et al., “Bengali cyberbullying detection in social media using machine learning algorithms,” in 2023 5th International Conference on Sustainable Technologies for Industry 5.0 (STI), IEEE, 2023, pp. 1–6. doi: 10.1109/STI59863.2023.10464740.
F. Baehaqi and N. Cahyono, “Analisis Sentimen Terhadap Cyberbullying Pada Komentar Di Instagram Menggunakan Algoritma Naïve Bayes,” The Indonesian Journal of Computer Science, vol. 13, no. 1, pp. 1051–1063, 2024, doi: 10.33022/ijcs.v13i1.3301.
Stephanie and H. Irsyad, “Analisis Sentimen Opini Publik Terhadap Cyberbullying Pada Komentar Instagram Menggunakan Multinomial Naive Bayes,” Jurnal Nasional Teknologi Komputer, vol. 4, no. 4, pp. 44–57, Oct. 2024, doi: 10.61306/jnastek.v4i4.157.
F. Anisa Nirmala, M. Jazman, N. E. Rozanda, and F. N. Salisah, “Cyberbullying Sentiment Analysis Of Instagram Comments Using Naïve Bayes Classifier And K-Nearest Neighbor Algorithm Methods,” Jurnal Teknik Informatika (Jutif), vol. 5, no. 5, pp. 1213–1219, May 2024, doi: 10.52436/1.jutif.2024.5.5.1997.
D. Warraihan, I. Permana, M. Mustakim, and R. Novita, “Analisis Sentimen Pengguna Transportasi Online Maxim Pada Instagram Menggunakan Naïve Bayes Classifier dan K-Nearest Neighbor,” Jurnal Media Informatika Budidarma, vol. 7, no. 3, pp. 1134–1143, 2023, doi: 10.30865/mib.v7i3.6336.
Y. Mubarok, D. Sudana, and W. Gunawan, “Hate Speech in the Comments’ Column Instagram: A Discourse Analysis,” Journal of Languages and Language Teaching, vol. 12, no. 1, pp. 439–450, 2024, doi: 10.33394/jollt.v12i1.9050.
A. Jalili, H. Tabrizchi, A. Mosavi, and A. R. Varkonyi-Koczy, “Enhancing Language Model Performance with a Novel Text Preprocessing Method,” Acta Phys. Pol. A, vol. 146, pp. 542–552, Nov. 2024, doi: 10.12693/APhysPolA.146.542.
D. A. B. Listiawan, W. A. Wicaksono, and Wiyanto, “Analisis Sentimen Publik pada Komentar Instagram Postingan Akun Tempodotco terhadap Penerapan Kurikulum AI di Indonesia Menggunakan Metode Naïve Bayes,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 9, no. 5, pp. 7881–7889, 2025, doi: 10.36040/jati.v9i5.14934.
S. K. Papia, M. A. Khan, T. Habib, M. Rahman, and M. N. Islam, “DistilRoBiLSTMFuse: an efficient hybrid deep learning approach for sentiment analysis,” PeerJ Comput. Sci., vol. 10, p. e2349, 2024, doi: 10.7717/peerj-cs.2349.
A. D. Saruksuk, E. Sianturi, M. I. Ahda, T. O. Panggabean, and M. W. Siregar, “Analisis Semantik di Balik Ujaran Provokatif di Media Sosial dan Implikasi Hukum dalam Kasus ‘Gus Mifta Menghina Penjual Es,’” Jurnal Pendidikan Tambusai, vol. 8, no. 3, pp. 50327–50332, Dec. 2024, Accessed: May 29, 2026. [Online]. Available: https://jptam.org/index.php/jptam/article/view/23838
R. A. Perdana, C. E. Widodo, and R. Santoso, “Sentiment Analysis of Naïve Bayes, Decision Tree, and K-Nearest Neighbor (K-NN) Algorithms for Cyberbullying Comments on Instagram Accounts,” in 2024 11th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), 2024, pp. 253–258. doi: 10.1109/ICITACEE62763.2024.10762775.
A. Anggara, Nurdin, and R. Meiyanti, “Sentiment Analysis of the MK Decision Trial of the Result of the 2024 President and Vice President General Election on Social Media X Using the Support Vector Machine Method,” International Journal of Engineering, Science and Information Technology, vol. 4, no. 4, pp. 125–134, 2024, doi: 10.52088/ijesty.v4i4.591.
E. Helmud, F. Fitriyani, and P. Romadiana, “Classification Comparison Performance of Supervised Machine Learning Random Forest and Decision Tree Algorithms Using Confusion Matrix,” Jurnal Sisfokom (Sistem Informasi dan Komputer), vol. 13, no. 1, pp. 92–97, Feb. 2024, doi: 10.32736/sisfokom.v13i1.1985.
N. W. S. Saraswati, C. P. Yanti, I. D. M. K. Muku, and D. A. P. R. Dewi, “Evaluation Analysis of the Necessity of Stemming and Lemmatization in Text Classification,” Matrik: Jurnal Manajemen, Teknik Informatika, dan Rekayasa Komputer, vol. 24, no. 2, pp. 321–332, 2025, doi: 10.30812/matrik.v24i2.4833.
S. F. C. Haviana, S. Mulyono, and Badie’Ah, “The Effects of Stopwords, Stemming, and Lemmatization on Pre-trained Language Models for Text Classification: A Technical Study,” in 2023 10th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), 2023, pp. 521–527. doi: 10.1109/EECSI59885.2023.10295797.
E. Qais and V. M. N, “TxtPrePro: Text Data Preprocessing Using Streamlit Technique for Text Analytics Process,” in 2023 International Conference on Network, Multimedia and Information Technology (NMITCON), 2023, pp. 1–6. doi: 10.1109/NMITCON58196.2023.10275887.
M. D. Bimantara and I. Zufria, “Text Mining Sentiment Analysis on Mobile Banking Application Reviews using TF-IDF Method with Natural Language Processing Approach,” JINAV: Journal of Information and Visualization, vol. 5, no. 1, pp. 115–123, Jul. 2024, doi: 10.35877/454RI.jinav2772.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Komparasi Naïve Bayes, SVM, dan Decision Tree untuk Klasifikasi Komentar Provokatif pada Instagram Terkait Aksi Demonstrasi Agustus 2025
Pages: 258-267
Copyright (c) 2026 Muhamad Yusuf, Erizal Erizal
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
